00010000:00010000:2.0F:1787574689.137584:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0F:1787574689.521588:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346899840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574689.521686:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574689.521755:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899840 00000100:00100000:0.0:1787574689.521765:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899840 00000100:00100000:0.0:1787574689.521821:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574689.521831:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346899840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574689.521871:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787574689.521920:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346899840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574689.521927:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574689.521987:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346899840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574689.526186:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346899968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574689.526283:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0F:1787574689.526420:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346899968 00000100:00100000:3.0:1787574689.526436:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346899968 00000100:00100000:3.0:1787574689.526492:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574689.526500:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346899968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574689.526537:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574689.532712:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346899968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6198us (6415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574689.532727:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574689.532959:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346899968:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0F:1787574689.777641:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787574689.777654:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574689.777679:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787574689.777685:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787574690.033469:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574690.033491:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5035dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346900096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787574690.033562:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574690.033612:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900096 00000100:00100000:0.0:1787574690.033621:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900096 00000100:00100000:0.0:1787574690.033687:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787574690.033697:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346900096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787574690.033727:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787574690.033775:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346900096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.033781:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787574690.033800:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574690.033856:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:0.0:1787574690.033868:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ca52e760700, transno 8589934596 00000004:00080000:0.0:1787574690.033887:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:0.0:1787574690.033917:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5035dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346900096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574690.035275:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574690.035292:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346900224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574690.035354:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574690.035443:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900224 00000100:00100000:3.0:1787574690.035449:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900224 00000100:00100000:3.0:1787574690.035496:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787574690.035505:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346900224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574690.035522:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574690.035560:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346900224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574690.035568:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1787574690.035585:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574690.035613:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346900224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574690.036343:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346900352:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036475:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346900608:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.036533:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346901120:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036558:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.036577:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346901632:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036598:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.036616:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574690.036622:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346900480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.036792:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346900992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.036814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.036832:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346901504:0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.037109:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900480 00000100:00100000:0.0:1787574690.037116:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900480 00000100:00100000:0.0:1787574690.037157:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787574690.037165:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346900480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.037214:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346900480:12345-0@lo:400:kworker.0 Request processed in 50us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.037221:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574690.037630:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.037763:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574690.037804:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346900480:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.037828:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900608 00000100:00100000:2.0:1787574690.037832:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900608 00000100:00100000:0.0:1787574690.039181:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901120 00000100:00100000:0.0:1787574690.039192:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901120 00000100:00100000:0.0:1787574690.039235:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901632 00000100:00100000:0.0:1787574690.039254:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901632 00000100:00100000:0.0:1787574690.039273:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901504 00000100:00100000:0.0:1787574690.039275:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901504 00000100:00100000:0.0:1787574690.039293:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574690.039301:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346901120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039377:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346901120:12345-0@lo:400:kworker.0 Request processed in 76us (2818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.039384:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574690.039412:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574690.039418:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346901632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039447:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346901632:12345-0@lo:400:kworker.0 Request processed in 29us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.039453:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574690.039481:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574690.039487:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346901504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039515:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346901504:12345-0@lo:400:kworker.0 Request processed in 29us (1753us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.039522:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574690.039548:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346900736:0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574690.039599:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900736 00000100:00100000:0.0:1787574690.039602:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900736 00000100:00100000:0.0:1787574690.039619:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787574690.039625:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346900736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039666:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346900736:12345-0@lo:400:kworker.0 Request processed in 41us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.039672:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787574690.039711:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900992 00000100:00100000:0.0:1787574690.039715:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900992 00000100:00100000:0.0:1787574690.039739:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787574690.039744:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346900992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574690.039772:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346900992:12345-0@lo:400:kworker.0 Request processed in 28us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574690.039778:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787574690.039806:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787574690.039810:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787574690.039813:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574690.039906:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900352 00000100:00100000:3.0:1787574690.039911:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900352 00000100:00100000:3.0:1787574690.039946:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787574690.039954:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346900352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574690.041145:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346900352:12345-0@lo:400:kworker.0 Request processed in 1187us (3510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574690.041156:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787574690.041302:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574690.041313:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346900608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.041363:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346900608:12345-0@lo:400:kworker.0 Request processed in 53us (4854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574690.041370:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574690.041414:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346900992:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.041426:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346901504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.041436:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346900608:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.041456:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346901120:0@lo:400:kworker.0 00010000:00080000:2.0:1787574690.041469:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5317f5180 x1874407346901632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574690.041479:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346901632:0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.041597:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346900352:0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.041607:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4041c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346900864:0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.041639:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574690.042214:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346900864 00000100:00100000:3.0:1787574690.042221:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346900864 00000100:00100000:3.0:1787574690.042280:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787574690.042288:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346900864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574690.042335:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346900864:12345-0@lo:400:kworker.0 Request processed in 48us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574690.042341:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787574690.042444:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346900736:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.042453:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346901248:0@lo:400:kworker.0 00000100:00100000:2.0:1787574690.042480:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574690.043504:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901248 00000100:00100000:3.0:1787574690.043513:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901248 00000100:00100000:3.0:1787574690.043581:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787574690.043589:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346901248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.044206:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4041c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346900864:0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.044218:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346901376:0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.044282:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574690.044335:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901376 00000100:00100000:1.0:1787574690.044340:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901376 00000100:00100000:1.0:1787574690.044382:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787574690.044576:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404039880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346901248:12345-0@lo:400:kworker.0 Request processed in 986us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574690.045099:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346901376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574690.045150:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346901376:12345-0@lo:400:kworker.0 Request processed in 57us (868us total) trans 0 rc 0/0 00000100:00080000:2.0:1787574690.045202:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574690.045206:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574690.045270:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346901248:0@lo:400:kworker.0 00010000:00080000:0.0:1787574690.045376:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca535d45f80 x1874407346901376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574706 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574690.045415:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346901376:0@lo:400:kworker.0 00000100:00100000:3.0:1787574690.048794:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574690.051261:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787574690.161398:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574691.195468:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787574691.581496:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1787574691.581522:0:17123:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ca505452480 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1787574691.581529:0:17123:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4034edf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ca505452180 00000020:00080000:2.0:1787574691.581532:0:17123:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ca4034ed200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ca5035b6800 00010000:00010000:0.0:1787574691.581689:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581702:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581709:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581715:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574691.581720:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581728:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581746:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:0.0:1787574691.581749:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574691.581754:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574691.581761:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a9e00/0xd18a1efeeddb97d2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20285 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787574691.582477:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:3.0:1787574691.582573:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:0.0:1787574692.062821:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574692.065558:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744512 00000100:00100000:3.0:1787574692.065578:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744512 00000100:00100000:3.0:1787574692.065715:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1787574692.065730:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:15606:x1874407323744512:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1787574692.065765:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574692.065884:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:15606:x1874407323744512:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 158us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574692.069542:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1787574692.081455:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574692.083461:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744640 00000100:00100000:0.0:1787574692.083481:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744640 00000100:00100000:0.0:1787574692.083569:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:0.0:1787574692.083602:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15606:x1874407323744640:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787574692.083731:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40403a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:15606:x1874407323744640:12345-192.168.202.40@tcp:60:lhsmtool_posix.0 Request processed in 134us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574692.083739:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00080000:2.0:1787574692.083824:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574692.093979:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574692.094162:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323744896 00000100:00100000:3.0:1787574692.094175:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323744896 00000100:00100000:3.0:1787574692.094269:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574692.094282:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:15606:x1874407323744896:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787574692.094632:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+14:15606:x1874407323744896:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 352us (664us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1787574692.094642:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00010000:00010000:2.0:1787574692.213898:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574692.594113:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574692.594147:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346901760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574692.594276:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574692.594719:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901760 00000100:00100000:3.0:1787574692.594732:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901760 00000100:00100000:3.0:1787574692.594812:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574692.594826:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346901760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574692.594864:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574692.594927:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404038a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346901760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574692.594936:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787574692.595009:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346901760:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787574692.595850:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574693.147076:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574693.147122:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574693.147168:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574693.147211:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574693.147568:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745280 00000100:00100000:1.0:1787574693.147578:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745280 00000100:00100000:1.0:1787574693.147638:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745664 00000100:00100000:1.0:1787574693.147641:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745664 00000100:00100000:1.0:1787574693.147676:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745152 00000100:00100000:1.0:1787574693.147683:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745152 00000100:00100000:1.0:1787574693.147700:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:1.0:1787574693.147710:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323745280:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574693.147917:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745024 00000100:00100000:0.0:1787574693.147932:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745024 00000100:00100000:0.0:1787574693.148002:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 171 00000100:00100000:0.0:1787574693.148015:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323745024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574693.148071:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:2.0:1787574693.148084:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+6:2403:x1874407323745664:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574693.151609:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323745280:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 3887us (4473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574693.151624:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 76 00000100:00100000:1.0:1787574693.151669:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00100000:1.0:1787574693.151682:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+14:2403:x1874407323745152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574693.151735:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+14:2403:x1874407323745152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 58us (4539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574693.151741:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 78 00000100:00080000:1.0:1787574693.151769:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787574693.152150:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574693.153121:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574693.154580:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745408 00000100:00100000:1.0:1787574693.154594:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745408 00000100:00100000:1.0:1787574693.154656:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745920 00000100:00100000:1.0:1787574693.154660:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745920 00000100:00100000:1.0:1787574693.156264:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1787574693.156280:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2401:x1874407323745408:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:1.0:1787574693.156313:0:18652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9501 00000100:00080000:1.0:1787574693.156340:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9ca510a5a000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787574693.156397:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2403:x1874407323745024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 8375us (9322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574693.156416:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 171 00000001:00000004:1.0:1787574693.156455:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1787574693.156493:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574693.156525:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574693.156546:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574693.156560:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+5:2401:x1874407323745920:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:0.0:1787574693.156593:0:18933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9540 00000100:00080000:0.0:1787574693.156605:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebeb800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787574693.156639:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+2:2401:x1874407323745408:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 361us (4488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574693.156649:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000001:00000004:0.0:1787574693.156656:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00010000:00010000:1.0:1787574693.156762:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574693.156777:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:26f06173-8373-497a-8777-dc305c5dce24+2:2401:x1874407323745920:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 221us (3659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574693.156787:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574693.157144:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574693.157175:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574693.157199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574693.157274:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745536 00000100:00100000:0.0:1787574693.157283:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745536 00000100:00100000:0.0:1787574693.157328:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746048 00000100:00100000:0.0:1787574693.157332:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746048 00000100:00100000:0.0:1787574693.157430:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1787574693.157439:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323745536:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574693.157491:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2403:x1874407323745536:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574693.157504:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1787574693.157628:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f06173-8373-497a-8777-dc305c5dce24+5:2401:x1874407323746048:12345-192.168.202.40@tcp:9:kworker.0 00000020:00000080:3.0:1787574693.157651:0:18650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9547 00000100:00080000:3.0:1787574693.157666:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9ca52e72b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574693.157709:0:18650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1787574693.157932:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:26f06173-8373-497a-8777-dc305c5dce24+6:2403:x1874407323745664:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 9847us (10758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574693.157945:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 77 00000100:00100000:2.0:1787574693.157975:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323745792 00000100:00100000:2.0:1787574693.157980:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323745792 00000100:00100000:2.0:1787574693.158024:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 79 00000100:00100000:2.0:1787574693.158032:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323745792:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574693.158066:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+5:2403:x1874407323745792:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 36us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574693.158072:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 79 00010000:00010000:2.0:1787574693.158115:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574693.158787:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:26f06173-8373-497a-8777-dc305c5dce24+2:2401:x1874407323746048:12345-192.168.202.40@tcp:9:kworker.0 Request processed in 1148us (1591us total) trans 0 rc 0/0 00000100:00080000:1.0:1787574693.159590:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574693.159600:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787574693.165634:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:3.0:1787574693.165662:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00010000:00010000:1.0:1787574693.233634:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574693.617553:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574693.617598:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346901888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574693.617703:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574693.617991:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346901888 00000100:00100000:3.0:1787574693.618005:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346901888 00000100:00100000:3.0:1787574693.618085:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574693.618096:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346901888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574693.618121:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574693.618212:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346901888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574693.618220:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1787574693.618303:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574693.618409:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346901888:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574694.257633:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574694.514067:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574694.641669:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346902016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574694.641748:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574694.641832:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902016 00000100:00100000:1.0:1787574694.641842:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902016 00000100:00100000:1.0:1787574694.641905:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787574694.641916:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346902016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574694.641952:0:17148:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787574694.642003:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346902016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574694.642010:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574694.642105:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346902016:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574694.647820:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346902144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574694.647895:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574694.648166:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902144 00000100:00100000:3.0:1787574694.648174:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902144 00000100:00100000:3.0:1787574694.648224:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574694.648232:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346902144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574694.648284:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1787574694.649206:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346902144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 969us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574694.649216:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574694.649295:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346902144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574695.153742:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346902528:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.153860:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574695.153924:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346903040:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.153953:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574695.153985:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346903552:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.154074:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346902656:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154106:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574695.154163:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574695.154175:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903552 00000100:00100000:0.0:1787574695.154186:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903552 00000100:00100000:1.0:1787574695.154206:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346903168:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.154278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574695.154323:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346903680:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154326:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574695.154351:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346903552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.154359:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574695.154404:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902656 00000100:00100000:1.0:1787574695.154414:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902656 00000100:00100000:0.0:1787574695.154465:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346903552:12345-0@lo:400:kworker.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574695.154477:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787574695.154486:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903168 00000100:00100000:1.0:1787574695.154493:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903168 00000100:00100000:0.0:1787574695.154507:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903680 00000100:00100000:0.0:1787574695.154514:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903680 00000100:00100000:1.0:1787574695.154540:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574695.154567:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574695.154568:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346902656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154589:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346903680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154656:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346903680:12345-0@lo:400:kworker.0 Request processed in 71us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574695.154666:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574695.154672:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346902656:12345-0@lo:400:kworker.0 Request processed in 117us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.154683:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574695.154710:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574695.154722:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346903168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154724:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902528 00000100:00100000:0.0:1787574695.154732:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902528 00000100:00100000:1.0:1787574695.154777:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346903168:12345-0@lo:400:kworker.0 Request processed in 57us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574695.154783:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903040 00000100:00100000:0.0:1787574695.154788:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903040 00000100:00100000:1.0:1787574695.154806:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574695.154815:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574695.154828:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346902528:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787574695.154843:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574695.154878:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346902528:12345-0@lo:400:kworker.0 Request processed in 53us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574695.154886:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787574695.154901:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787574695.154907:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346903040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154936:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346903040:12345-0@lo:400:kworker.0 Request processed in 29us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574695.154942:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787574695.154987:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346902528:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.154998:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346903040:0@lo:400:kworker.0 00000100:00080000:1.0:1787574695.155389:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574695.155398:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574695.155445:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346902656:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.155457:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346903168:0@lo:400:kworker.0 00010000:00080000:1.0:1787574695.155470:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5317f5880 x1874407346903680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574695.155480:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346903680:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156297:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5035de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346902272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574695.156371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574695.156401:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346902912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156423:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574695.156445:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346903424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156468:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574695.156490:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346903936:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156507:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574695.156529:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1787574695.156536:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346902400:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156648:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574695.156682:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902272 00000100:00100000:2.0:1787574695.156689:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346902784:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.156689:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902272 00000100:00100000:1.0:1787574695.156740:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787574695.156749:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346902272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574695.156778:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574695.156789:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574695.156811:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346903296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.156820:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346902272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574695.156831:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574695.156841:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574695.156848:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346903808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574695.156871:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574695.156878:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574695.156916:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5035de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346902272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574695.156918:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902912 00000100:00100000:1.0:1787574695.156922:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902912 00000100:00100000:1.0:1787574695.156939:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903424 00000100:00100000:1.0:1787574695.156942:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903424 00000100:00100000:2.0:1787574695.156946:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902400 00000100:00100000:2.0:1787574695.156949:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902400 00000100:00100000:1.0:1787574695.156951:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903936 00000100:00100000:1.0:1787574695.156953:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903936 00000100:00100000:1.0:1787574695.156969:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903808 00000100:00100000:1.0:1787574695.156971:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903808 00000100:00100000:2.0:1787574695.156974:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787574695.156979:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346902400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.156984:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574695.156996:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346902912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157031:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346902912:12345-0@lo:400:kworker.0 Request processed in 35us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157037:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787574695.157049:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787574695.157055:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346903424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157082:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346903424:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157088:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787574695.157100:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787574695.157105:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346903936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157128:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346903936:12345-0@lo:400:kworker.0 Request processed in 24us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157133:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787574695.157144:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787574695.157150:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346903808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157172:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1874407346903808:12345-0@lo:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157178:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787574695.157195:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574695.157202:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574695.157233:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346902784 00000100:00100000:1.0:1787574695.157264:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346902784 00000100:00100000:1.0:1787574695.157281:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346903296 00000100:00100000:1.0:1787574695.157284:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346903296 00000100:00100000:1.0:1787574695.157314:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574695.157321:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346902784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157359:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346902784:12345-0@lo:400:kworker.0 Request processed in 39us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157365:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574695.157377:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574695.157382:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346903296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157407:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346903296:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574695.157412:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787574695.157425:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574695.157510:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346902784:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157525:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346903296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157533:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3635:1874407346903808:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157544:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346902912:0@lo:400:kworker.0 00000100:00100000:1.0:1787574695.157553:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346903424:0@lo:400:kworker.0 00010000:00080000:1.0:1787574695.157573:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5317f7480 x1874407346903936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574695.157583:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346903936:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.157745:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346903552:0@lo:400:kworker.0 00000100:00100000:0.0:1787574695.157788:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346904064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574695.157969:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574695.158196:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904064 00000100:00100000:3.0:1787574695.158204:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904064 00000100:00100000:3.0:1787574695.159090:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574695.159108:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5035de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346904064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574695.159161:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787574695.159474:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346904064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574695.160083:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5035de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346904064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 978us (2110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574695.160093:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787574695.161288:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5218c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346902400:12345-0@lo:400:kworker.0 Request processed in 4296us (4626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574695.161315:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787574695.161665:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346902400:0@lo:400:kworker.0 00010000:00010000:1.0:1787574695.283135:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574696.310927:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787574696.555157:0:20523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 08:31:34 (1787574694) 00010000:00010000:0.0:1787574697.337058:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574697.715778:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574697.715804:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346904192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574697.715888:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574697.715985:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904192 00000100:00100000:1.0:1787574697.715994:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904192 00000100:00100000:1.0:1787574697.716064:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574697.716075:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346904192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574697.716104:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574697.716171:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346904192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574697.716179:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574697.716231:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346904192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787574697.717414:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787574697.723579:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1787574697.723596:0:17123:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:3.0:1787574697.723763:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:3.0:1787574697.723775:0:17183:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000100:00100000:2.0:1787574698.254208:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574698.254416:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746176 00000100:00100000:0.0:1787574698.254427:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746176 00000100:00100000:0.0:1787574698.254492:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:0.0:1787574698.254503:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323746176:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574698.254574:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2404:x1874407323746176:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 73us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574698.254583:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 173 00000100:00100000:3.0:1787574698.272104:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574698.272209:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574698.272255:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574698.272319:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746560 00000100:00100000:2.0:1787574698.272330:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746560 00000100:00100000:2.0:1787574698.272408:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1787574698.272419:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2405:x1874407323746560:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574698.272494:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2405:x1874407323746560:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574698.272514:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00080000:2.0:1787574698.272540:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574698.277797:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746304 00000100:00100000:1.0:1787574698.277815:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746304 00000100:00100000:1.0:1787574698.277949:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746816 00000100:00100000:1.0:1787574698.277953:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746816 00000100:00100000:3.0:1787574698.278003:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1787574698.278016:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:2404:x1874407323746304:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574698.278104:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:2404:x1874407323746304:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 90us (6013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574698.278113:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 86 00000100:00100000:3.0:1787574698.278556:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574698.278676:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574698.278699:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746432 00000100:00100000:3.0:1787574698.278704:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746432 00000100:00080000:2.0:1787574698.278978:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574698.278983:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574698.279042:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323746688 00000100:00100000:0.0:1787574698.279047:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323746688 00000100:00100000:0.0:1787574698.279107:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00100000:0.0:1787574698.279118:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2405:x1874407323746688:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574698.279174:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:26f06173-8373-497a-8777-dc305c5dce24+6:2405:x1874407323746688:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574698.279181:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 87 00000100:00080000:2.0:1787574698.280518:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574698.280694:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:1.0:1787574698.280707:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2405:x1874407323746816:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574698.280774:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2405:x1874407323746816:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 72us (8518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574698.280781:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 88 00000100:00100000:3.0:1787574698.282026:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 89 00000100:00100000:3.0:1787574698.282038:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2405:x1874407323746432:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574698.282097:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2405:x1874407323746432:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 62us (3543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574698.282104:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 89 00010000:00010000:2.0:1787574698.364075:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574698.750834:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000020:00000080:1.0:1787574698.750845:0:18646:0:(genops.c:885:class_export_put()) final put ffff9ca507da1800/26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:1.0:1787574698.750865:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:1.0:1787574698.750868:0:18646:0:(genops.c:885:class_export_put()) final put ffff9ca510a5d000/1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:1.0:1787574698.750885:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca507da1800/26f06173-8373-497a-8777-dc305c5dce24 for lustre-OST0000 00000020:00000080:1.0:1787574698.750933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca510a5d000/1d414e73-1942-4e41-ad1c-8720ad754d4d for lustre-OST0000 00000020:00000080:1.0:1787574698.750947:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca51ebeb800 for lustre-OST0000 00000020:00000080:1.0:1787574698.750952:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca510a5a000 for lustre-OST0000 00000100:00100000:1.0:1787574698.751920:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346904320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574698.751990:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574698.752046:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904320 00000100:00100000:1.0:1787574698.752053:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904320 00000100:00100000:1.0:1787574698.752111:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574698.752121:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346904320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574698.752156:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1787574698.754334:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574698.754513:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346904320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2389us (2518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574698.754526:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574698.757118:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346904320:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1787574698.787930:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000020:00000080:0.0:1787574698.787939:0:19464:0:(genops.c:885:class_export_put()) final put ffff9ca53bc3c000/26f06173-8373-497a-8777-dc305c5dce24 00000020:00000080:1.0:1787574698.792819:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53bc3c000/26f06173-8373-497a-8777-dc305c5dce24 for lustre-OST0001 00000020:00000080:1.0:1787574698.792879:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca52e72b800 for lustre-OST0001 00010000:00010000:0.0:1787574699.377628:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574699.761653:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574699.761678:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346904448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574699.761771:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574699.761931:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346904576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574699.762080:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904448 00000100:00100000:3.0:1787574699.762089:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904448 00000100:00100000:3.0:1787574699.762144:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574699.762152:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346904448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574699.762201:0:18100:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787574699.763223:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574699.763397:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904576 00000100:00100000:0.0:1787574699.763404:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904576 00000100:00100000:0.0:1787574699.763447:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787574699.763455:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346904576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574699.763487:0:17149:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574699.763541:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346904576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574699.763548:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574699.763639:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346904576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574699.763742:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346904448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1589us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574699.763750:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787574699.763823:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e762a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346904448:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1787574700.017530:0:17179:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787574700.017540:0:17179:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574700.017561:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787574700.017569:0:17179:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787574700.273699:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574700.273724:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346904704:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574700.273799:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.273900:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904704 00000100:00100000:0.0:1787574700.273909:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904704 00000100:00100000:0.0:1787574700.273974:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574700.273985:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346904704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574700.274015:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787574700.274063:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346904704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.274071:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574700.274132:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346904704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574700.274404:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346904960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274436:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274464:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346905472:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274485:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274501:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346905984:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274523:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274542:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1787574700.274548:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346904832:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274573:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274591:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346905344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274609:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274622:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346905856:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274638:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574700.274661:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905984 00000100:00100000:3.0:1787574700.274665:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905984 00000100:00100000:3.0:1787574700.274693:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905344 00000100:00100000:3.0:1787574700.274696:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905344 00000100:00100000:3.0:1787574700.274711:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905856 00000100:00100000:3.0:1787574700.274713:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905856 00000100:00100000:3.0:1787574700.274726:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787574700.274732:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346905984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274777:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346905984:12345-0@lo:400:kworker.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574700.274784:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787574700.274798:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574700.274804:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346905344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274830:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346905344:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574700.274836:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574700.274847:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787574700.274853:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346905856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274877:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346905856:12345-0@lo:400:kworker.0 Request processed in 25us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574700.274883:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787574700.274906:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904960 00000100:00100000:3.0:1787574700.274910:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904960 00000100:00100000:3.0:1787574700.274928:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905472 00000100:00100000:3.0:1787574700.274931:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905472 00000100:00100000:3.0:1787574700.274942:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574700.274947:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346904960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.274978:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346904960:12345-0@lo:400:kworker.0 Request processed in 30us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574700.274983:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787574700.274993:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574700.274998:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.275020:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346905472:12345-0@lo:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574700.275034:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574700.275077:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346905344:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.275086:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346905856:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.275094:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346904960:0@lo:400:kworker.0 00000100:00100000:3.0:1787574700.275102:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346905472:0@lo:400:kworker.0 00010000:00080000:3.0:1787574700.275130:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74ca80 x1874407346905984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574700.275140:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346905984:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275380:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346905088:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275416:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275445:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346905600:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275465:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275480:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346906112:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275522:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787574700.275528:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346905216:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275549:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275564:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346905728:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275581:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275594:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346906240:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275611:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574700.275631:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906112 00000100:00100000:0.0:1787574700.275635:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906112 00000100:00100000:0.0:1787574700.275657:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905728 00000100:00100000:0.0:1787574700.275660:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905728 00000100:00100000:0.0:1787574700.275672:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906240 00000100:00100000:0.0:1787574700.275675:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906240 00000100:00100000:0.0:1787574700.275687:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574700.275692:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346906112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275724:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346906112:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.275730:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787574700.275741:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574700.275747:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346905728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275769:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346905728:12345-0@lo:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.275781:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787574700.275793:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574700.275798:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346906240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275826:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346906240:12345-0@lo:400:kworker.0 Request processed in 28us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.275832:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787574700.275865:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346905728:0@lo:400:kworker.0 00010000:00080000:0.0:1787574700.275876:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503785500 x1874407346906240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574700.275885:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503785500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346906240:0@lo:400:kworker.0 00000100:00100000:0.0:1787574700.275895:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503787480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346906112:0@lo:400:kworker.0 00000100:00080000:1.0:1787574700.275975:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574700.275980:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574700.275982:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574700.275997:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905088 00000100:00100000:1.0:1787574700.276001:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905088 00000100:00100000:1.0:1787574700.276040:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905600 00000100:00100000:1.0:1787574700.276043:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905600 00000100:00100000:1.0:1787574700.276054:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346905216 00000100:00100000:1.0:1787574700.276056:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346905216 00000100:00100000:1.0:1787574700.276068:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574700.276074:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346905088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574700.276123:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346905088:12345-0@lo:400:kworker.0 Request processed in 37us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.276136:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787574700.276149:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574700.276155:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346905600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574700.276183:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346905600:12345-0@lo:400:kworker.0 Request processed in 29us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.276188:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574700.276198:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574700.276204:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346905216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574700.276228:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346905216:12345-0@lo:400:kworker.0 Request processed in 24us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.276234:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574700.276290:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346905216:0@lo:400:kworker.0 00000100:00100000:1.0:1787574700.276299:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346905088:0@lo:400:kworker.0 00000100:00100000:1.0:1787574700.276307:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346905600:0@lo:400:kworker.0 00000100:00100000:2.0:1787574700.276715:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346904832 00000100:00100000:2.0:1787574700.276721:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346904832 00000100:00100000:2.0:1787574700.276755:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787574700.276762:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346904832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574700.276810:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3635:x1874407346904832:12345-0@lo:400:kworker.0 Request processed in 49us (2237us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574700.276817:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1787574700.276866:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346904832:0@lo:400:kworker.0 00000100:00080000:0.0:1787574700.276934:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574700.276937:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574700.277060:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574700.277071:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346906368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574700.277101:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574700.277209:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906368 00000100:00100000:1.0:1787574700.277214:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906368 00000100:00100000:1.0:1787574700.277272:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574700.277280:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346906368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574700.277294:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787574700.277339:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346906368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.277346:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574700.277413:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346906368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787574700.401480:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574700.524735:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574700.524861:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323747072 00000100:00100000:1.0:1787574700.524870:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323747072 00000100:00100000:1.0:1787574700.524959:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1787574700.524969:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+13:16367:x1874407323747072:12345-192.168.202.40@tcp:35:umount.0 00000100:00080000:0.0:1787574700.525016:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787574700.525195:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1787574700.525323:0:17147:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1787574700.525453:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:16367:x1874407323747072:12345-192.168.202.40@tcp:35:umount.0 Request processed in 484us (727us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1787574700.525461:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000020:00080000:1.0:1787574700.525466:0:17147:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787574700.554518:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574700.554553:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574700.554585:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574700.554638:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574700.554741:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323747328 00000100:00100000:0.0:1787574700.554750:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323747328 00000100:00100000:0.0:1787574700.554830:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323747200 00000100:00100000:0.0:1787574700.554834:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323747200 00000100:00100000:0.0:1787574700.554846:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323747456 00000100:00100000:0.0:1787574700.554849:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323747456 00000100:00100000:0.0:1787574700.554863:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574700.554884:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+15:2405:x1874407323747328:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574700.554900:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574700.554919:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75e00/0xd18a1efeeddb94e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba6b expref: 15 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574700.554951:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574700.555001:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503786300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+14:2405:x1874407323747328:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 128us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.555008:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574700.555026:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:0.0:1787574700.555032:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+13:2405:x1874407323747200:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574700.555041:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574700.555050:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb94de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba3a expref: 13 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574700.555058:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574700.555076:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574700.555076:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c1e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:2405:x1874407323747200:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 45us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574700.555082:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574700.555085:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ab24719-8af9-48f9-8992-e0214b678d6f+12:2405:x1874407323747456:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574700.555093:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574700.555101:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500031c00/0xd18a1efeeddb956a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb21 expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574700.555110:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574700.555128:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503784000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9ab24719-8af9-48f9-8992-e0214b678d6f+10:2405:x1874407323747456:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.555134:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:1.0:1787574700.555154:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323747584 00000100:00100000:1.0:1787574700.555157:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323747584 00000100:00100000:1.0:1787574700.555194:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1787574700.555200:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2401:x1874407323747584:12345-192.168.202.40@tcp:9:umount.0 00000020:00000080:1.0:1787574700.555229:0:18933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9508 00000100:00080000:1.0:1787574700.555235:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca4030fb800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1787574700.555274:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787574700.555285:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787574700.555307:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787574700.555447:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1d414e73-1942-4e41-ad1c-8720ad754d4d+2:2401:x1874407323747584:12345-192.168.202.40@tcp:9:umount.0 Request processed in 245us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574700.555464:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:3.0:1787574700.574160:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574700.575564:0:17142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323748480 00000100:00100000:0.0:1787574700.575579:0:17142:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323748480 00000100:00100000:0.0:1787574700.575666:0:17142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:0.0:1787574700.575677:0:17142:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+16:2401:x1874407323748480:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:0.0:1787574700.575710:0:17142:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb94f3 00000020:00010000:0.0:1787574700.575727:0:17142:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca40442b800: total 0 00000100:00080000:0.0:1787574700.575731:0:17142:0:(import.c:65:import_set_state_nolock()) ffff9ca40442c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574700.575765:0:17142:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:0.0:1787574700.575936:0:17142:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1d414e73-1942-4e41-ad1c-8720ad754d4d+15:2401:x1874407323748480:12345-192.168.202.40@tcp:39:umount.0 Request processed in 260us (1793us total) trans 8589934627 rc 0/0 00000100:00100000:0.0:1787574700.575962:0:17142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000020:00010000:3.0:1787574700.578224:0:17132:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca40442b800: total 0 00010000:00010000:3.0:1787574700.578617:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574700.578712:0:17132:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca40442b800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787574700.578761:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:3.0:1787574700.578766:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574700.578782:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9619 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb3d expref: 14 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578810:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9ca534a4b200) 00010000:00010000:3.0:1787574700.578813:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574700.578835:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8600/0xd18a1efeeddb97a8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbbb expref: 13 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578863:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca534a4b700) 00010000:00010000:3.0:1787574700.578866:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574700.578871:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409dc00/0xd18a1efeeddb95be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb28 expref: 12 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578906:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9ca534a4bf00) 00010000:00010000:3.0:1787574700.578909:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787574700.578914:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5035a8000/0xd18a1efeeddb969e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb67 expref: 11 pid: 19986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578943:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574700.578947:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574700.578952:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa800/0xd18a1efeeddb974d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bba6 expref: 10 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578967:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca502b84b00) 00010000:00010000:3.0:1787574700.578969:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574700.578973:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502fabe00/0xd18a1efeeddb95da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb2f expref: 9 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.578992:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574700.578995:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787574700.578999:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca502faa200/0xd18a1efeeddb971c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb91 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.579011:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9ca51874a400) 00010000:00010000:3.0:1787574700.579020:0:17132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574700.579025:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9803 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbde expref: 7 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574700.579053:0:17132:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca40442b800, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1787574700.579070:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574700.579072:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574700.579074:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574700.590433:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574700.590549:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323748608 00000100:00100000:3.0:1787574700.590566:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323748608 00000100:00100000:3.0:1787574700.590672:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:3.0:1787574700.590685:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+5:2401:x1874407323748608:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:3.0:1787574700.590735:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb94fa 00000100:00080000:3.0:1787574700.590758:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca404429000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574700.590793:0:17145:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1787574700.590814:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574700.591227:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574700.591678:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1d414e73-1942-4e41-ad1c-8720ad754d4d+3:2401:x1874407323748608:12345-192.168.202.40@tcp:39:umount.0 Request processed in 992us (1250us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787574700.591689:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00010000:00010000:3.0:1787574701.425481:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574702.423561:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574702.423618:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574702.423670:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574702.423737:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323748736 00000100:00100000:2.0:1787574702.423753:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323748736 00000100:00100000:2.0:1787574702.424331:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323748992 00000100:00100000:2.0:1787574702.424337:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323748992 00000100:00100000:0.0:1787574702.427433:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323748864 00000100:00100000:0.0:1787574702.427458:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323748864 00000100:00100000:0.0:1787574702.427550:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574702.427575:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+12:2403:x1874407323748736:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574702.427598:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574702.427625:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030000/0xd18a1efeeddb951d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9baaa expref: 12 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574702.427649:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574702.431221:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+11:2403:x1874407323748736:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 3641us (7659us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574702.431283:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574702.431344:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574702.431360:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+10:2403:x1874407323748992:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574702.431384:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574702.431413:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb9563 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb1a expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574702.431434:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574702.431463:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+9:2403:x1874407323748992:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 110us (7846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574702.431469:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574702.431482:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574702.431508:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+8:2403:x1874407323748864:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574702.431518:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574702.431528:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83600/0xd18a1efeeddb9524 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9badb expref: 8 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574702.431536:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574702.431555:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9ab24719-8af9-48f9-8992-e0214b678d6f+7:2403:x1874407323748864:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 49us (7885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574702.431561:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574702.436636:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574702.436703:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323749248 00000100:00100000:0.0:1787574702.436715:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323749248 00000100:00100000:0.0:1787574702.436822:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574702.436836:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+6:2401:x1874407323749248:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:0.0:1787574702.436886:0:17144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9532 00000020:00010000:0.0:1787574702.436896:0:17144:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca4035ba000: total 0 00000100:00080000:0.0:1787574702.436902:0:17144:0:(import.c:65:import_set_state_nolock()) ffff9ca4035bd000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574702.436941:0:17144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:3.0:1787574702.437155:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574702.438702:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:26f06173-8373-497a-8777-dc305c5dce24+5:2401:x1874407323749248:12345-192.168.202.40@tcp:39:umount.0 Request processed in 1854us (2069us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1787574702.438718:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000020:00010000:0.0:1787574702.438833:0:17131:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca4035ba000: total 0 00010000:00010000:0.0:1787574702.438907:0:17131:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca4035ba000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787574702.438958:0:17131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4be00) 00010000:00010000:0.0:1787574702.438964:0:17131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574702.438975:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bb44 expref: 4 pid: 20285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574702.439029:0:17131:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca4035ba000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787574702.439044:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574702.439046:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574702.439049:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574702.449499:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574702.472346:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574702.472440:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323749376 00000100:00100000:2.0:1787574702.472450:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323749376 00000100:00100000:2.0:1787574702.472532:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1787574702.472542:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+5:2401:x1874407323749376:12345-192.168.202.40@tcp:39:umount.0 00000020:00000080:2.0:1787574702.472580:0:20285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9539 00000100:00080000:2.0:1787574702.472590:0:20285:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787574702.472617:0:20285:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787574702.472743:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:26f06173-8373-497a-8777-dc305c5dce24+3:2401:x1874407323749376:12345-192.168.202.40@tcp:39:umount.0 Request processed in 202us (406us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787574702.472751:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00010000:00010000:0.0:1787574702.472835:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574702.473228:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574702.514573:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574702.515781:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323749632 00000100:00100000:1.0:1787574702.515797:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323749632 00000100:00100000:1.0:1787574702.515868:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 175 00000100:00100000:1.0:1787574702.515880:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+7:2401:x1874407323749632:12345-192.168.202.40@tcp:251:umount.0 00000020:00000080:1.0:1787574702.515926:0:17137:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb94d0 00000020:00010000:1.0:1787574702.515935:0:17137:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca510a58800: total 0 00000100:00080000:1.0:1787574702.515940:0:17137:0:(import.c:65:import_set_state_nolock()) ffff9ca510a58000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1787574702.516083:0:17132:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca510a58800: total 0 00010000:00010000:3.0:1787574702.516087:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574702.516148:0:17132:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca510a58800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787574702.516187:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82e00/0xd18a1efeeddb94d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9ba33 expref: 3 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574702.516204:0:17132:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca510a58800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787574702.516231:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574702.516273:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574702.516275:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574702.516539:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9ab24719-8af9-48f9-8992-e0214b678d6f+1:2401:x1874407323749632:12345-192.168.202.40@tcp:251:umount.0 Request processed in 660us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574702.516793:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 175 00000020:00000080:1.0:1787574702.516806:0:17137:0:(genops.c:885:class_export_put()) final put ffff9ca510a58800/9ab24719-8af9-48f9-8992-e0214b678d6f 00000020:00000080:0.0:1787574702.516923:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca510a58800/9ab24719-8af9-48f9-8992-e0214b678d6f for MGS 00000020:00000080:0.0:1787574702.516957:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca510a58000 for MGS 00000100:00100000:2.0:1787574702.836265:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346906496:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574702.836344:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574702.836466:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906496 00000100:00100000:0.0:1787574702.836475:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906496 00000100:00100000:0.0:1787574702.836525:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574702.836536:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346906496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574702.836565:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574702.836613:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4041c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346906496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574702.836620:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574702.836662:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346906496:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787574702.837198:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574703.474100:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574703.857473:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346906624:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574703.857550:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574703.857653:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906624 00000100:00100000:3.0:1787574703.857661:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906624 00000100:00100000:3.0:1787574703.857724:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574703.857734:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346906624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574703.857756:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574703.857801:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346906624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574703.857809:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1787574703.859827:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574703.859899:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346906624:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1787574704.239197:0:20718:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787574704.261070:0:20718:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787574704.261129:0:20718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.261230:0:20718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.261379:0:20718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.261403:0:20718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.261455:0:20718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787574704.261462:0:20718:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787574704.261488:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574704.261493:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787574704.261499:0:20718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787574704.261524:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787574704.261593:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346906752:0@lo:39:umount.0 00000100:00100000:1.0:1787574704.261661:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574704.261758:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906752 00000100:00100000:0.0:1787574704.261767:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906752 00000100:00100000:0.0:1787574704.261824:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574704.261834:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874407346906752:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787574704.261988:0:17145:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb90c4 00000100:00080000:0.0:1787574704.261998:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9ca5205ae800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787574704.262063:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574704.262072:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.262079:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409da00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574704.262083:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.262092:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574704.262099:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574704.262105:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574704.262107:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787574704.262111:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787574704.262213:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.262334:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787574704.262383:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346906880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574704.262421:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574704.262481:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.262489:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca40409da00/0xd18a1efeeddb9093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb909a expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.262502:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574704.262505:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574704.262507:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574704.262548:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346906880 00000100:00100000:1.0:1787574704.262553:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346906880 00000100:00100000:1.0:1787574704.262605:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574704.262621:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3637:x1874407346906880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574704.262634:0:17128:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574704.262650:0:17128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb909a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb9093 expref: 24 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.262662:0:17128:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574704.262808:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3633:x1874407346906752:12345-0@lo:39:umount.0 Request processed in 974us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574704.262815:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:0.0:1787574704.262825:0:17145:0:(genops.c:885:class_export_put()) final put ffff9ca4035e5800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787574704.262883:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574704.263041:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:3637:x1874407346906880:12345-0@lo:103:ldlm_bl.0 Request processed in 421us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574704.263048:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1787574704.263091:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca403184800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787574704.263110:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346906752:0@lo:39:umount.0 00000100:00080000:0.0:1787574704.263231:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574704.263235:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787574704.263263:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787574704.264418:0:20718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264434:0:20718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264458:0:20718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264465:0:20718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264484:0:20718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574704.264492:0:20718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264498:0:20718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264504:0:20718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264510:0:20718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574704.264684:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346906880:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787574704.264717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4035e5800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787574704.264771:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5205ae800 for lustre-MDT0000 00010000:00010000:0.0:1787574704.264829:0:20718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574704.264838:0:20718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264846:0:20718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264851:0:20718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.264880:0:20718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.265366:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574704.265374:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.265382:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faac00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574704.265386:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.265394:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574704.265401:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574704.265406:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787574704.265408:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787574704.265435:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.265452:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787574704.265516:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346907008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574704.265575:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574704.265733:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574704.266034:0:20718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574704.266044:0:20718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.266052:0:20718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.266057:0:20718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.266063:0:20718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574704.266072:0:20718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787574704.266074:0:20718:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787574704.266078:0:20718:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787574704.266113:0:20718:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787574704.266116:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787574704.266120:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574704.266125:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787574704.266142:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca40442a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574704.266149:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca5350a0800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574704.266153:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca40270a000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574704.266157:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ca53f4a5000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574704.266173:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ca4035ba000 26f06173-8373-497a-8777-dc305c5dce24 192.168.202.40@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787574704.266177:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9ca40442b800 1d414e73-1942-4e41-ad1c-8720ad754d4d 192.168.202.40@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787574704.266183:0:20718:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ca4032c8000) has exports, disconnecting them 00000020:00080000:0.0:1787574704.266187:0:20718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca40442a000), last request at 1787574700 00000020:00000080:0.0:1787574704.266193:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb93bf 00000100:00080000:0.0:1787574704.266208:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca404429800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787574704.266287:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca40442a000): rc 0 00000020:00000080:0.0:1787574704.266290:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca40442a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787574704.266303:0:20718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca5350a0800), last request at 1787574700 00000020:00000080:0.0:1787574704.266307:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9268 00000100:00080000:0.0:1787574704.266312:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787574704.266318:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350a0800): rc 0 00000020:00000080:0.0:1787574704.266320:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca5350a0800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787574704.266324:0:20718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca40270a000), last request at 1787574622 00000020:00000080:0.0:1787574704.266326:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb91b2 00000100:00080000:0.0:1787574704.266329:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca402709800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787574704.266334:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca40270a000): rc 0 00000020:00000080:0.0:1787574704.266336:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca40270a000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787574704.266339:0:20718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ca53f4a5000), last request at 1787574622 00000020:00000080:0.0:1787574704.266342:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9150 00000100:00080000:0.0:1787574704.266345:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca53f4a4000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574704.266350:0:20718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1787574704.266415:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca53f4a5000): rc 0 00000004:00000080:0.0:1787574704.266422:0:20718:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7bcc1dbfae0 00000100:00080000:0.0:1787574704.266443:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574704.266447:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:1.0:1787574704.267249:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.267261:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502faac00/0xd18a1efeeddb8fe4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8feb expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.267281:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574704.267285:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.267292:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574704.267296:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.267305:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574704.267312:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574704.267318:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787574704.267321:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787574704.267323:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787574704.267355:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.267362:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1787574704.267440:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40442a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787574704.267487:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a0800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787574704.267511:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40270a000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787574704.267532:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca404429800 for lustre-MDT0000 00000020:00000080:3.0:1787574704.267536:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5350a5800 for lustre-MDT0000 00000020:00000080:3.0:1787574704.267540:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca402709800 for lustre-MDT0000 00000100:00080000:0.0:1787574704.267993:0:20718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787574704.268021:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787574704.268076:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907264:0@lo:39:umount.0 00000100:00100000:3.0:1787574704.268150:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574704.268413:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787574704.268417:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787574704.268429:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787574704.268497:0:20718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787574704.268509:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787574704.268758:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574704.268769:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346907136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574704.268806:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574704.268853:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907008 00000100:00100000:2.0:1787574704.268974:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907008 00000100:00100000:2.0:1787574704.269035:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907136 00000100:00100000:2.0:1787574704.269038:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907136 00000100:00100000:2.0:1787574704.269062:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574704.269081:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+24:3634:x1874407346907008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574704.269096:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574704.269117:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e18400/0xd18a1efeeddb8feb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb8fe4 expref: 24 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574704.269260:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907392:0@lo:9:umount.0 00000100:00100000:3.0:1787574704.269294:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574704.269328:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907264 00000100:00100000:3.0:1787574704.269332:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907264 00000100:00100000:3.0:1787574704.269363:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574704.269371:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346907264:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787574704.269397:0:18100:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb91dc 00000100:00080000:3.0:1787574704.269411:0:18100:0:(import.c:65:import_set_state_nolock()) ffff9ca40270d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787574704.269428:0:18100:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787574704.269546:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3633:x1874407346907264:12345-0@lo:39:umount.0 Request processed in 175us (1395us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787574704.269554:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787574704.269596:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787574704.269603:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907264:0@lo:39:umount.0 00010000:00010000:1.0:1787574704.269687:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269707:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb959b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb95a2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269719:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574704.269723:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269731:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574704.269735:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269744:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574704.269752:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574704.269758:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787574704.269761:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787574704.269764:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787574704.269785:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269792:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574704.269811:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269818:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502faa600/0xd18a1efeeddb8fd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb8fdd expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.269839:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574704.269841:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574704.269842:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574704.270009:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574704.270040:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+23:3634:x1874407346907008:12345-0@lo:103:ldlm_bl.0 Request processed in 961us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574704.270047:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574704.270063:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574704.270070:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53c1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+22:3634:x1874407346907136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574704.270079:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574704.270089:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca500030c00/0xd18a1efeeddb95a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb959b expref: 22 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574704.270099:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574704.270121:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53c1e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3634:x1874407346907136:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574704.270126:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787574704.270256:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574704.270260:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787574704.270271:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787574704.270332:0:20718:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787574704.270346:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787574704.270388:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ca4032c8000) has no exports 00000100:00100000:2.0:1787574704.270562:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907392 00000100:00100000:2.0:1787574704.270568:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907392 00000100:00100000:2.0:1787574704.270616:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787574704.270623:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346907392:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787574704.270640:0:18652:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb92a7 00000100:00080000:2.0:1787574704.270648:0:18652:0:(import.c:65:import_set_state_nolock()) ffff9ca402033000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787574704.270683:0:18652:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787574704.270788:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503785f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3633:x1874407346907392:12345-0@lo:9:umount.0 Request processed in 165us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574704.270803:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574704.271281:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346907520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574704.271317:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574704.271383:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907648:0@lo:9:umount.0 00000100:00100000:3.0:1787574704.271412:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574704.271468:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907520 00000100:00100000:1.0:1787574704.271472:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907520 00000100:00100000:1.0:1787574704.271515:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574704.271522:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+21:3636:x1874407346907520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574704.271532:0:17129:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574704.271548:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e18e00/0xd18a1efeeddb8fdd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb8fd6 expref: 21 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574704.271560:0:17129:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574704.271589:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:3636:x1874407346907520:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574704.271595:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574704.271613:0:18933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907648 00000100:00100000:1.0:1787574704.271617:0:18933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907648 00000100:00100000:1.0:1787574704.271640:0:18933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574704.271647:0:18933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3633:x1874407346907648:12345-0@lo:9:umount.0 00000020:00000080:1.0:1787574704.271661:0:18933:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb93fe 00000100:00080000:1.0:1787574704.271667:0:18933:0:(import.c:65:import_set_state_nolock()) ffff9ca40442d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787574704.271694:0:18933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787574704.271775:0:18933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503785880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3633:x1874407346907648:12345-0@lo:9:umount.0 Request processed in 128us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574704.271793:0:18933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574704.271825:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346907520:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787574704.271955:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4037f4000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:2.0:1787574704.272253:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574704.272257:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574704.272259:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574704.272342:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574704.272346:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1787574704.272599:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787574704.272603:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574704.272608:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907648:0@lo:9:umount.0 00000100:00080000:3.0:1787574704.272628:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebe0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787574704.272644:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787574704.272646:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574704.272649:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346907392:0@lo:9:umount.0 00010000:00010000:3.0:1787574704.272672:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.272681:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574704.272685:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.272694:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574704.272700:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574704.272714:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574704.272717:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787574704.272720:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787574704.272748:0:17132:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.272754:0:17132:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574704.272770:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.272776:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502fab200/0xd18a1efeeddb93f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93f7 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574704.272787:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574704.272789:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574704.272790:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574704.272809:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346907136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574704.272817:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3634:1874407346907008:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574704.273074:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574704.273085:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574704.273097:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346907776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574704.273227:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574704.273487:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907776 00000100:00100000:2.0:1787574704.273493:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907776 00000100:00100000:2.0:1787574704.273573:0:20172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574704.273582:0:20172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+20:3636:x1874407346907776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574704.273595:0:20172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574704.273611:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca502faba00/0xd18a1efeeddb93f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb93f0 expref: 20 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574704.273622:0:20172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574704.273707:0:20172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3636:x1874407346907776:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574704.273714:0:20172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574704.273780:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503785c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346907776:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787574704.279039:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ca4032c8000) has no exports 00000020:00000080:3.0:1787574704.371418:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9031 00000020:00000080:3.0:1787574704.371432:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca51ebe6800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787574704.371452:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787574704.371526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca51ebe6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787574704.371549:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574704.371559:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574704.371564:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ca53b148000) has no exports 00000020:00000080:2.0:1787574704.371833:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb902a 00000020:00000080:2.0:1787574704.371839:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca4010c7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787574704.371906:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574704.371913:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787574704.371916:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca4010c6800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787574704.371918:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4010c6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787574704.371922:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1787574704.372094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4010c7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1787574704.497515:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787574704.755531:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574704.881520:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346907904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574704.881595:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574704.881706:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346907904 00000100:00100000:0.0:1787574704.881714:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346907904 00000100:00100000:0.0:1787574704.881761:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574704.881768:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874407346907904:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1787574704.881776:0:17148:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787574704.881826:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503785c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1874407346907904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (230us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787574704.881834:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:02020000:2.0:1787574704.881963:0:3634:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787574704.892178:0:3634:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787574704.892185:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787574704.892190:0:3634:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787574704.908399:0:3634:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574704.908413:0:3634:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:2.0:1787574704.908422:0:3634:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca534a3d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574704.908463:0:3634:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f4e00 x1874407346908032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574704.909193:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346908032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787574704.909322:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574704.909441:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908032 00000100:00100000:0.0:1787574704.909449:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908032 00000100:00100000:0.0:1787574704.909493:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787574704.909501:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346908032:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787574704.909519:0:17149:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574704.912206:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346908032:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 2695us (2875us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574704.912232:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787574704.913201:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574704.913208:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574704.913222:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346908032:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1787574705.395692:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346908288:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.395770:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574705.395809:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346908800:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.395832:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574705.395852:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787574705.395857:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346908416:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.395875:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574705.395888:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346908928:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.395903:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574705.395930:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908288 00000100:00100000:3.0:1787574705.395937:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908288 00000100:00100000:3.0:1787574705.395989:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908416 00000100:00100000:3.0:1787574705.395992:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908416 00000100:00100000:3.0:1787574705.396017:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574705.396026:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346908288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.396077:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503784380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346908288:12345-0@lo:400:kworker.0 Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574705.396084:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574705.396099:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574705.396104:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346908416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.396130:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503787480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346908416:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574705.396150:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787574705.396172:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787574705.396175:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574705.396200:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346908416:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.396222:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346908288:0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396547:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346908160:0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396587:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574705.396627:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346908672:0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396655:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574705.396687:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346909184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574705.396709:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574705.396728:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787574705.396734:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346908544:0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396754:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574705.396768:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346909056:0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396787:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574705.396813:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908800 00000100:00100000:1.0:1787574705.396817:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908800 00000100:00100000:1.0:1787574705.396844:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908928 00000100:00100000:1.0:1787574705.396847:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908928 00000100:00100000:1.0:1787574705.396855:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908672 00000100:00100000:1.0:1787574705.396857:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908672 00000100:00100000:1.0:1787574705.396863:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908544 00000100:00100000:1.0:1787574705.396864:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908544 00000100:00100000:1.0:1787574705.396870:0:19986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909056 00000100:00100000:1.0:1787574705.396878:0:19986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909056 00000100:00100000:1.0:1787574705.396894:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574705.396899:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346908800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396935:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503786300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346908800:12345-0@lo:400:kworker.0 Request processed in 35us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574705.396941:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574705.396955:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574705.396961:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346909056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574705.396991:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346909056:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574705.396997:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574705.397008:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574705.397012:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874407346908928:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787574705.397018:0:19986:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787574705.397042:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3636:x1874407346908928:12345-0@lo:400:kworker.0 Request processed in 27us (1137us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574705.397047:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787574705.397058:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574705.397062:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1874407346908672:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787574705.397065:0:19986:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787574705.397086:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1874407346908672:12345-0@lo:400:kworker.0 Request processed in 23us (430us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574705.397091:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787574705.397100:0:19986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574705.397104:0:19986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1874407346908544:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1787574705.397107:0:19986:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787574705.397135:0:19986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1874407346908544:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574705.397140:0:19986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1787574705.397166:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574705.397171:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787574705.397175:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787574705.397180:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574705.397184:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 561 00000100:00080000:1.0:1787574705.397189:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca40270c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574705.397223:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5317f5880 x1874407346909312/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574705.397278:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346908544:0@lo:400:kworker.0 00010000:00080000:1.0:1787574705.397292:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca403745f80 x1874407346909056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574705.397302:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403745f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346909056:0@lo:400:kworker.0 00000100:00080000:1.0:1787574705.397310:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574705.397313:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787574705.397316:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787574705.397319:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574705.397321:0:3635:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 581 00000100:00080000:1.0:1787574705.397325:0:3635:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca5109bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574705.397339:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5317f4380 x1874407346909440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574705.397359:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346908672:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.397989:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346908160 00000100:00100000:3.0:1787574705.397995:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346908160 00000100:00100000:3.0:1787574705.398036:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574705.398046:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3635:x1874407346908160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.398100:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3635:x1874407346908160:12345-0@lo:400:kworker.0 Request processed in 57us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574705.398107:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787574705.398141:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346909312:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787574705.398164:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574705.398181:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346909440:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787574705.398201:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574705.404106:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909184 00000100:00100000:2.0:1787574705.404122:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909184 00000100:00080000:3.0:1787574705.404162:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787574705.404168:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787574705.404174:0:3636:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787574705.404180:0:3636:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574705.404186:0:3636:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 598 00000100:00100000:2.0:1787574705.404187:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1787574705.404195:0:3636:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca4023fe000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574705.404202:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346909184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574705.404259:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574705.404271:0:3636:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503583b80 x1874407346909568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574705.404312:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346908928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574705.404337:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346909184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (7623us total) trans 0 rc 0/0 00010000:00080000:3.0:1787574705.404338:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503581880 x1874407346908800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574705.404353:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574705.404360:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346908800:0@lo:400:kworker.0 00000100:00100000:3.0:1787574705.404425:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346909568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787574705.405919:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574705.431511:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909312 00000100:00100000:2.0:1787574705.431527:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909312 00000100:00080000:2.0:1787574705.431554:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787574705.431594:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909440 00000100:00100000:2.0:1787574705.431597:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909440 00000100:00100000:2.0:1787574705.431605:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909568 00000100:00100000:2.0:1787574705.431608:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909568 00000100:00100000:2.0:1787574705.431624:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574705.431632:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909312:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787574705.431652:0:20285:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787574705.431739:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909312:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 107us (33573us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787574705.431762:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574705.431779:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787574705.431783:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909440:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1787574705.431790:0:20285:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787574705.431814:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909440:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 30us (33612us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787574705.431820:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787574705.431829:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787574705.431832:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787574705.431838:0:20285:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787574705.431854:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346909568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 21us (25941us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787574705.431858:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787574705.431899:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574705.431905:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574705.431909:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346909568:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787574705.431920:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574705.431923:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574705.431926:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346909312:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1787574705.431934:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574705.431937:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787574705.431940:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346909440:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1787574705.432179:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346908160:0@lo:400:kworker.0 00000100:00100000:2.0:1787574705.432199:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503784700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346909184:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1787574705.523422:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574706.548062:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787574706.932086:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787574706.932102:0:17876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1787574706.932117:0:17876:0:(genops.c:885:class_export_put()) final put ffff9ca52675e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787574706.932138:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000001:00080000:1.0:1787574706.932143:0:17876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1787574706.932145:0:17876:0:(genops.c:885:class_export_put()) final put ffff9ca4035bb800/26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:1.0:1787574706.932150:0:17876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000001:00080000:1.0:1787574706.932154:0:17876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1787574706.932156:0:17876:0:(genops.c:885:class_export_put()) final put ffff9ca40442e800/1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:0.0:1787574706.932302:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1787574706.932364:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4035bb800/26f06173-8373-497a-8777-dc305c5dce24 for lustre-MDT0001 00000020:00000080:0.0:1787574706.932389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40442e800/1d414e73-1942-4e41-ad1c-8720ad754d4d for lustre-MDT0001 00000020:00000080:0.0:1787574706.932415:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40270d000 for lustre-MDT0001 00000020:00000080:0.0:1787574706.932420:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5109bd800 for lustre-MDT0001 00000020:00000080:0.0:1787574706.932423:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca404429000 for lustre-MDT0001 00000001:00100000:3.0:1787574706.933429:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574706.933435:0:17123:0:(genops.c:885:class_export_put()) final put ffff9ca53f4a5000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1787574706.933458:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 26f06173-8373-497a-8777-dc305c5dce24 00000001:00080000:3.0:1787574706.933464:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1787574706.933467:0:17123:0:(genops.c:885:class_export_put()) final put ffff9ca4035ba000/26f06173-8373-497a-8777-dc305c5dce24 00000001:00100000:3.0:1787574706.933471:0:17123:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000001:00080000:3.0:1787574706.933475:0:17123:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1787574706.933480:0:17123:0:(genops.c:885:class_export_put()) final put ffff9ca40442b800/1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:0.0:1787574706.933541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53f4a5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1787574706.933572:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4035ba000/26f06173-8373-497a-8777-dc305c5dce24 for lustre-MDT0000 00000020:00000080:0.0:1787574706.933593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40442b800/1d414e73-1942-4e41-ad1c-8720ad754d4d for lustre-MDT0000 00000020:00000080:0.0:1787574706.933617:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53f4a4000 for lustre-MDT0000 00000020:00000080:0.0:1787574706.933621:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4035bd000 for lustre-MDT0000 00000020:00000080:0.0:1787574706.933624:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40442c000 for lustre-MDT0000 00000001:00100000:2.0:1787574706.933736:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787574706.933740:0:19464:0:(genops.c:885:class_export_put()) final put ffff9ca40442f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787574706.933757:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:2.0:1787574706.933759:0:19464:0:(genops.c:885:class_export_put()) final put ffff9ca4030fd000/1d414e73-1942-4e41-ad1c-8720ad754d4d 00000020:00000080:1.0:1787574706.933803:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40442f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787574706.933838:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4030fd000/1d414e73-1942-4e41-ad1c-8720ad754d4d for lustre-OST0001 00000020:00000080:1.0:1787574706.933852:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40442d000 for lustre-OST0001 00000020:00000080:1.0:1787574706.933855:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4030fb800 for lustre-OST0001 00010000:00010000:2.0:1787574707.569524:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574708.593524:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574708.979788:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574708.979817:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346909696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574708.979898:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574708.980031:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909696 00000100:00100000:2.0:1787574708.980040:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909696 00000100:00100000:2.0:1787574708.980112:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574708.980122:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346909696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787574708.980151:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574708.980215:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346909696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574708.980222:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574708.980297:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346909696:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787574708.980484:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787574709.618646:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574710.003140:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.003151:0:18646:0:(genops.c:885:class_export_put()) final put ffff9ca402031000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787574710.003224:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca402031000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787574710.003734:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca402033000 for lustre-OST0000 00000020:01000000:2.0:1787574710.452593:0:20718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca40320c720 - data ffff9ca509279000/ffff9ca4042d4400 00000020:01000000:2.0:1787574710.452752:0:20718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4037ff240 - data ffff9ca5275a7798/ffff9ca51088b400 00000001:00000004:2.0:1787574710.458736:0:20718:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1787574710.513419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574710.513427:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787574710.513431:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574710.513441:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 644 00000100:00100000:0.0:1787574710.513442:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346909824:0@lo:400:kworker.0 00000100:00080000:1.0:1787574710.513446:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787574710.513471:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca534a3d800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574710.513509:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579fb80 x1874407346909952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574710.513525:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574710.513547:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574710.513550:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787574710.513551:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574710.513555:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1787574710.513558:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787574710.513561:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca40270c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574710.513571:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579ca80 x1874407346910336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574710.513579:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574710.513581:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787574710.513583:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574710.513585:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1787574710.513587:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787574710.513590:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca5109bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574710.513599:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579e300 x1874407346910464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574710.513601:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909824 00000100:00100000:0.0:1787574710.513609:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909824 00000100:00080000:1.0:1787574710.513615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574710.513618:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787574710.513620:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574710.513623:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 644 00000100:00080000:1.0:1787574710.513625:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787574710.513633:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca4023fe000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574710.513647:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579f800 x1874407346910720/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574710.513653:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787574710.513662:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3637:x1874407346909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574710.513673:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346910592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.513708:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b+19:3637:x1874407346909824:12345-0@lo:400:kworker.0 Request processed in 47us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574710.513715:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574710.513715:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787574710.513738:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574710.513744:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346910848:0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.513764:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346910208:0@lo:400:kworker.0 00000100:00100000:1.0:1787574710.513765:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574710.513799:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574710.513802:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910592 00000100:00100000:1.0:1787574710.513806:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910592 00000100:00100000:0.0:1787574710.513821:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574710.513827:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346910080:0@lo:400:kworker.0 00000100:00100000:1.0:1787574710.513840:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910848 00000100:00100000:1.0:1787574710.513844:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910848 00000100:00100000:0.0:1787574710.513847:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574710.513864:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787574710.513870:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346910592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.513880:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346909952:0@lo:38:kworker.0 00000100:00100000:0.0:1787574710.513904:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574710.513908:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346910592:12345-0@lo:400:kworker.0 Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574710.513914:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574710.513920:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346910336:0@lo:38:kworker.0 00000100:00100000:1.0:1787574710.513927:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787574710.513932:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346910848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.513939:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574710.513953:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346910464:0@lo:38:kworker.0 00000100:00100000:1.0:1787574710.513954:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346910848:12345-0@lo:400:kworker.0 Request processed in 22us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574710.513960:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787574710.513969:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910336 00000100:00100000:0.0:1787574710.513971:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574710.513972:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910336 00000100:00100000:0.0:1787574710.513980:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346910720:0@lo:38:kworker.0 00000100:00100000:1.0:1787574710.513981:0:20285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910464 00000100:00100000:1.0:1787574710.513983:0:20285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910464 00000100:00100000:1.0:1787574710.513991:0:20285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787574710.514002:0:20285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346910336:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787574710.514006:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:1.0:1787574710.514018:0:20285:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574710.514029:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910208 00000100:00100000:0.0:1787574710.514032:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910208 00000100:00100000:0.0:1787574710.514057:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910080 00000100:00100000:0.0:1787574710.514060:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910080 00000100:00100000:0.0:1787574710.514093:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574710.514100:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346910208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.514134:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346910208:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574710.514140:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574710.514152:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574710.514158:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346910080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.514196:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346910080:12345-0@lo:400:kworker.0 Request processed in 38us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574710.514202:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574710.514231:0:18100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346909952 00000100:00100000:0.0:1787574710.514234:0:18100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346909952 00000100:00100000:0.0:1787574710.514275:0:18100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574710.514280:0:18100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346909952:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787574710.514288:0:18100:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574710.514324:0:18100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346909952:12345-0@lo:38:kworker.0 Request processed in 42us (419us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574710.514330:0:18100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787574710.514376:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346910080:0@lo:400:kworker.0 00000100:00100000:0.0:1787574710.514388:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346910208:0@lo:400:kworker.0 00000100:00080000:0.0:1787574710.514416:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574710.514420:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574710.514424:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346909952:0@lo:38:kworker.0 00000100:00100000:0.0:1787574710.514439:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910720 00000100:00100000:0.0:1787574710.514443:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910720 00000100:00100000:0.0:1787574710.514457:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787574710.514461:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346910464:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787574710.514468:0:17144:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574710.514497:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346910464:12345-0@lo:38:kworker.0 Request processed in 35us (525us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574710.514504:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787574710.514515:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787574710.514518:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346910720:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1787574710.514526:0:17144:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787574710.514547:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346910720:12345-0@lo:38:kworker.0 Request processed in 27us (540us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574710.514561:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1787574710.514583:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574710.514587:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574710.514590:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346910464:0@lo:38:kworker.0 00000100:00080000:0.0:1787574710.514598:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574710.514601:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574710.514604:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346910720:0@lo:38:kworker.0 00000100:00080000:0.0:1787574710.514632:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787574710.514636:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574710.514638:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787574710.514656:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3637:1874407346909824:0@lo:400:kworker.0 00010000:00080000:0.0:1787574710.514690:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53579e680 x1874407346910848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574710.514700:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346910848:0@lo:400:kworker.0 00010000:00080000:0.0:1787574710.514710:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53579c000 x1874407346910592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574710.514719:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346910592:0@lo:400:kworker.0 00000100:00100000:3.0:1787574710.519224:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346910976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574710.519309:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574710.519371:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346910976 00000100:00100000:0.0:1787574710.519380:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346910976 00000100:00100000:0.0:1787574710.519428:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574710.519438:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346910976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574710.519468:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787574710.519528:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346910976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574710.519547:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574710.519723:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346910976:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1787574710.521739:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787574710.521747:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787574710.521759:0:20718:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9ca503581c00 x1874407346907264/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787574714 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574710.521887:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1787574710.525623:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787574710.525632:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1787574710.525651:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787574710.525654:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787574710.528569:0:17167:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787574710.528576:0:17167:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787574710.528587:0:17167:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00100000:1.0:1787574710.529880:0:20285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3633:x1874407346910336:12345-0@lo:38:kworker.0 Request processed in 15870us (15932us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574710.529894:0:20285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787574710.529946:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574710.529951:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787574710.529954:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346910336:0@lo:38:kworker.0 00000100:00080000:0.0:1787574710.530694:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787574710.530700:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1787574710.530721:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574710.530724:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787574710.531708:0:17169:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787574710.531714:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1787574710.531725:0:17169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787574710.535714:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb8ff9 00000020:00000080:1.0:1787574710.535731:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca503099000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787574710.536179:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca503099000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787574710.537578:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb900e 00000020:00000080:1.0:1787574710.537588:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca50309d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787574710.537644:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787574710.537649:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574710.537657:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787574710.537661:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ca4032cb370) has no exports 00000004:01000000:1.0:1787574710.537821:0:20718:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787574710.537829:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9070 00000020:00000080:1.0:1787574710.537833:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca4033dc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.538271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787574710.538358:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787574710.538364:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574710.538370:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574710.538373:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9ca402220000) has no exports 00000020:00000080:1.0:1787574710.538381:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9069 00000020:00000080:1.0:1787574710.538386:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca4037f3800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787574710.538404:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033dc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1787574710.538788:0:20718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787574710.538793:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787574710.538798:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787574710.538803:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574710.538806:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574710.538842:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4037f3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787574710.538924:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574710.538931:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574710.538938:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb905b 00000020:00000080:1.0:1787574710.538943:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca403185000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.538962:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4037f4000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1787574710.538969:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca403180800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.538971:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403180800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1787574710.538976:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787574710.539550:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787574710.539557:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574710.539563:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574710.539567:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ca53b14cd28) has no exports 00000020:00000080:1.0:1787574710.539571:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9054 00000020:00000080:1.0:1787574710.539576:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca403183800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787574710.539592:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403185000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1787574710.539998:0:20718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787574710.540001:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787574710.540005:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787574710.540009:0:20718:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787574710.540011:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574710.540176:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403183800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787574710.540453:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574710.540460:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787574710.540473:0:20718:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787574710.540479:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9046 00000020:00000080:1.0:1787574710.540485:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca403185800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.540503:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca51ebe0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787574710.540510:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca403186800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.540512:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403186800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1787574710.540516:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787574710.540636:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787574710.540641:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574710.540646:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787574710.540649:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff9ca4024cb370) has no exports 00000020:00000080:1.0:1787574710.540653:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb903f 00000020:00000080:1.0:1787574710.540658:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca51ebe5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787574710.540673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca403185800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787574710.542129:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca51ebe5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1787574710.542366:0:20718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1787574710.542372:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574710.542387:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574710.542393:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574710.542462:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca51ebe7800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1787574710.542497:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.542504:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574710.542509:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca51ebe4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.542512:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca51ebe4800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1787574710.542516:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574710.542610:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.542614:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574710.542617:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca50309c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787574710.542620:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787574710.542623:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787574710.542673:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9015 00000020:00000080:0.0:1787574710.542680:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca50309f800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787574710.542722:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787574710.542727:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574710.542731:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574710.542734:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ca4032ccd28) has no exports 00000020:00000080:0.0:1787574710.542750:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.542753:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787574710.542757:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb901c 00000020:00000080:0.0:1787574710.542760:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca50309d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574710.542862:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787574710.542866:0:8:0:(genops.c:885:class_export_put()) final put ffff9ca50309f000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787574710.542867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309f000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787574710.542873:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787574710.542956:0:20718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53f52b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787574710.542960:0:20718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53f52b800 3 00000020:01000004:0.0:1787574710.542967:0:20718:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca53f52b800 from lustre-MDT0000 00000020:00000080:3.0:1787574710.542989:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787574710.543037:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.543042:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787574710.543045:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca50309a000/lustre-MDT0000_UUID 00000020:00000080:0.0:1787574710.543047:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787574710.543054:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787574710.543228:0:20718:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1787574710.543266:0:20718:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787574710.543270:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787574710.543273:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574710.543277:0:20718:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574710.543283:0:20718:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9ca5204a9800 c736e7c1-73c2-4d34-bc3f-9b57260ebf6b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574710.543289:0:20718:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9ca4024ccd28) has exports, disconnecting them 00000020:00080000:0.0:1787574710.543294:0:20718:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9ca5204a9800), last request at 1787574606 00000020:00000080:0.0:1787574710.543308:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb8fba 00000020:00010000:0.0:1787574710.543312:0:20718:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ca5204a9800: total 0 00000100:00080000:0.0:1787574710.543316:0:20718:0:(import.c:65:import_set_state_nolock()) ffff9ca5204af000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787574710.543333:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5204a9800): rc 0 00000020:00080000:0.0:1787574710.543337:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9ca4024ccd28) has no exports 00000100:00100000:0.0:1787574710.543386:0:17136:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9ca53bfe0a00:17136] 1 exiting: rc = 0 00000100:00100000:0.0:1787574710.543473:0:17137:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9ca53bfe0200:17137] 2 exiting: rc = 0 00000020:00010000:3.0:1787574710.543535:0:20719:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ca5204a9800: total 0 00010000:00010000:3.0:1787574710.543561:0:20719:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ca5204a9800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1787574710.543590:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb9379 expref: 14 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543604:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409c600/0xd18a1efeeddb9222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb921b expref: 13 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543615:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb90e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb90d9 expref: 12 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543630:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409c200/0xd18a1efeeddb90ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb90e7 expref: 11 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543640:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e19800/0xd18a1efeeddb9586 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb957f expref: 10 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543661:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409d400/0xd18a1efeeddb90fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb90f5 expref: 9 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543670:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409ce00/0xd18a1efeeddb93aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb93a3 expref: 8 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543680:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb8fcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb8fc8 expref: 7 pid: 17136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543690:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca502faae00/0xd18a1efeeddb93e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb93e2 expref: 6 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543702:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca40409c000/0xd18a1efeeddb924c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb9245 expref: 5 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543712:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82600/0xd18a1efeeddb9578 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb9571 expref: 4 pid: 17137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543722:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca502fab400/0xd18a1efeeddb919d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb9196 expref: 3 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543737:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd18a1efeeddb958d expref: 2 pid: 17135 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574710.543748:0:20719:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ca5204a9800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1787574710.543763:0:20719:0:(genops.c:885:class_export_put()) final put ffff9ca5204a9800/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b 00010000:00010000:3.0:1787574710.543773:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574710.543775:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574710.543777:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574710.543814:0:17135:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9ca53bfe0600:17135] 0 exiting: rc = 1 00000020:00000080:3.0:1787574710.543855:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5204a9800/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b for MGS 00000020:00000080:3.0:1787574710.543878:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5204af000 for MGS 00000100:00100000:0.0:1787574710.543937:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543945:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543951:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543957:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543963:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543969:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543974:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543980:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543986:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543991:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.543996:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544002:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544020:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544158:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544176:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544182:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544189:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544194:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544200:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544214:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544219:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544224:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544230:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544235:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544307:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544314:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544319:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544324:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544330:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544335:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544341:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544347:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544352:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544358:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544365:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544370:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544375:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544381:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544387:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544393:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544398:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544404:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544410:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544415:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544421:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544426:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544432:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544437:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544441:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544447:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544454:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544459:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544464:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544469:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544481:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544487:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544492:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544497:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544503:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544509:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544514:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544519:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544524:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574710.544529:0:20718:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1787574710.545946:0:20718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4034c2600 - data ffff9ca5093feca8/ffff9ca52efc7400 00000020:01000000:0.0:1787574710.546087:0:20718:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4019a7360 - data ffff9ca5276f0af8/ffff9ca535088400 00000020:00000080:0.0:1787574710.546537:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb8fa5 00000020:00000080:0.0:1787574710.546548:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca40410e000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787574710.546564:0:20718:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53f52b800 from MGS, refs=2 00000020:01000004:0.0:1787574710.546568:0:20718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53f52b800 2 00000020:01000004:0.0:1787574710.546572:0:20718:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca53f52b800 from MGS 00000020:00000080:0.0:1787574710.546594:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.546600:0:20718:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787574710.546603:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca404109800/MGS 00000020:00000080:0.0:1787574710.546606:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca404109800/MGS for MGS 00000020:01000000:0.0:1787574710.546614:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787574710.546681:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787574710.546685:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574710.546691:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574710.546699:0:20718:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9ca53f52a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574710.546705:0:20718:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9ca402224d28) has exports, disconnecting them 00000020:00080000:0.0:1787574710.546709:0:20718:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9ca53f52a000), last request at 1787574606 00000020:00000080:0.0:1787574710.546713:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb90a8 00000020:00080000:0.0:1787574710.546721:0:20718:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca53f52a000): rc 0 00000020:00000080:0.0:1787574710.546725:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca53f52a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787574710.546945:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40410e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787574710.546953:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53f52a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787574710.617376:0:20718:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787574710.617394:0:20718:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787574710.617399:0:20718:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574710.617408:0:20718:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574710.617482:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca403184800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787574710.617598:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574710.617606:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787574710.617611:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca4033da000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787574710.617614:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033da000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787574710.617620:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787574710.617689:0:20718:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53f52b800 1 00000020:00000080:0.0:1787574710.617700:0:20718:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb8f97 00000020:00000080:0.0:1787574710.617707:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca40410e800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787574710.617713:0:20718:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787574710.617717:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574710.617721:0:20718:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574710.617724:0:20718:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9ca4022219b8) has no exports 00000020:00000080:3.0:1787574710.618063:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca40410e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1787574710.641843:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787574710.680876:0:20718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574710.680890:0:20718:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787574710.680895:0:20718:0:(genops.c:885:class_export_put()) final put ffff9ca53f529000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787574710.680899:0:20718:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53f529000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787574710.680905:0:20718:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787574710.681012:0:20718:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca53f52c000 00000020:02000400:3.0:1787574710.681189:0:20718:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787574711.669698:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574712.690341:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574713.715324:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574714.101343:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346911104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787574714.101444:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574714.101532:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346911104 00000100:00100000:3.0:1787574714.101542:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346911104 00000100:00100000:3.0:1787574714.101618:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787574714.101631:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346911104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574714.101669:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574714.101718:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346911104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574714.101726:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1787574714.101750:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574714.102212:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346911104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787574714.742618:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787574714.789533:0:20921:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787574714.809926:0:20921:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1787574714.810007:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.810025:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.810032:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.810071:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.810095:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787574714.810102:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787574714.810158:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574714.810165:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787574714.810172:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574714.810180:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca40270c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787574714.810186:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574714.810298:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787574714.810317:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787574714.810805:0:20719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574714.810816:0:20719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574714.810825:0:20719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502faa000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574714.810829:0:20719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574714.810840:0:20719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574714.810849:0:20719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574714.810855:0:20719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787574714.810858:0:20719:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787574714.810860:0:20719:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787574714.810914:0:20719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574714.810921:0:20719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574714.810959:0:20719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574714.810966:0:20719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502faa000/0xd18a1efeeddb9196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb919d expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574714.810982:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574714.810984:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574714.810999:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574714.811024:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346911232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574714.811118:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574714.811147:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574714.811148:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811161:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811169:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811198:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574714.811208:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811235:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811268:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.811273:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812443:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787574714.812459:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812468:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812473:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812479:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812496:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787574714.812500:0:20921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812505:0:20921:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812525:0:20921:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812531:0:20921:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574714.812537:0:20921:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1787574714.812540:0:20921:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1787574714.812575:0:20921:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1787574714.812579:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787574714.812583:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574714.812591:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1787574714.812599:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ca5350ca800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787574714.812605:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9ca4023ff800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787574714.812612:0:20921:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9ca52eeacd28) has exports, disconnecting them 00000020:00080000:2.0:1787574714.812617:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ca5350ca800), last request at 1787574710 00000020:00000080:2.0:1787574714.812625:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb93d4 00000100:00080000:2.0:1787574714.812648:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca4030ff000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787574714.812698:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350ca800): rc 0 00000020:00000080:2.0:1787574714.812701:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca5350ca800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1787574714.812718:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9ca4023ff800), last request at 1787574710 00000020:00000080:2.0:1787574714.812721:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9276 00000100:00080000:2.0:1787574714.812725:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca4023f8000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787574714.812731:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca4023ff800): rc 0 00000020:00000080:2.0:1787574714.812732:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca4023ff800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1787574714.812739:0:20921:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa7bcc1c9bae0 00000100:00080000:2.0:1787574714.812758:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:1.0:1787574714.812764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350ca800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:2.0:1787574714.812775:0:20921:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9ca503581180 x1874407346907904/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787574720 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574714.812797:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:1.0:1787574714.812845:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4023ff800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787574714.812880:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4030ff000 for lustre-MDT0001 00000020:00000080:1.0:1787574714.812886:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4023f8000 for lustre-MDT0001 00010000:00010000:1.0:1787574714.813412:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787574714.813423:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813449:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19c00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574714.813454:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813465:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574714.813473:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574714.813485:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787574714.813489:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1787574714.813492:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:1.0:1787574714.813542:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813549:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574714.813577:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813585:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19c00/0xd18a1efeeddb90f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90fc expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813613:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574714.813619:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787574714.813620:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574714.813633:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca534a3d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:1.0:1787574714.813637:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574714.813643:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813658:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574714.813666:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574714.813672:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787574714.813675:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787574714.813678:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787574714.813695:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813701:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574714.813723:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813729:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb93e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb93e9 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813743:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574714.813747:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574714.813758:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1787574714.813763:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500030e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574714.813770:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813778:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574714.813783:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346911488:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1787574714.813806:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574714.813813:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787574714.813815:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787574714.813817:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787574714.813837:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813844:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574714.813852:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813859:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500030e00/0xd18a1efeeddb958d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb9594 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574714.813875:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574714.813889:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574714.813894:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813901:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574714.813904:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813913:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574714.813920:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574714.813938:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00100000:2.0:1787574714.813941:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346911616:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1787574714.813943:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787574714.813949:0:17131:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:2.0:1787574714.813975:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574714.813978:0:17131:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.813988:0:17131:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574714.813999:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.814006:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19e00/0xd18a1efeeddb90e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd18a1efeeddb90ee expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574714.814023:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574714.814025:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346911232 00010000:00010000:1.0:1787574714.814026:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574714.814031:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574714.814035:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346911232 00010000:00010000:1.0:1787574714.814059:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574714.814080:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346911488 00000100:00100000:1.0:1787574714.814088:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346911488 00000100:00100000:2.0:1787574714.814093:0:20172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346911616 00000100:00100000:2.0:1787574714.814099:0:20172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346911616 00000100:00100000:2.0:1787574714.814130:0:20172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574714.814144:0:20172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1874407346911232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574714.814150:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00020000:2.0:1787574714.814159:0:20172:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574714 with bad export cookie 15098914780974124986 00000100:00100000:1.0:1787574714.814166:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1874407346911616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787574714.814185:0:17129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574714 with bad export cookie 15098914780974124986 00000100:00100000:1.0:1787574714.814310:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1874407346911616:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (333us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574714.814319:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574714.814340:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787574714.814345:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1874407346911488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787574714.814348:0:17129:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787574714 with bad export cookie 15098914780974124986 00000100:00100000:1.0:1787574714.814387:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3635:x1874407346911488:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (523us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787574714.814393:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787574714.814431:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.140@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787574714.814437:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787574714.814441:0:3635:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.140@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1787574714.815710:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346907904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574714.822848:0:20172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3636:x1874407346911232:12345-0@lo:103:ldlm_bl.0 Request processed in 8699us (11693us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787574714.822865:0:20172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1787574714.823031:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787574714.823038:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787574714.823067:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787574714.823762:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787574714.823791:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787574714.823825:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787574714.823830:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787574714.823848:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787574714.823941:0:20921:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787574714.823957:0:20921:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787574714.824157:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ca52eeacd28) has no exports 00010000:00010000:2.0:1787574714.825332:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574714.845388:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346911872:0@lo:9:umount.0 00000100:00100000:0.0:1787574714.845786:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574714.845915:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346912000:0@lo:9:umount.0 00000100:00100000:0.0:1787574714.845945:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574714.846002:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346911872 00000100:00100000:0.0:1787574714.846012:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346911872 00000100:00100000:0.0:1787574714.846071:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346912000 00000100:00100000:0.0:1787574714.846074:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346912000 00000100:00100000:0.0:1787574714.846110:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574714.846131:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874407346911872:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787574714.846169:0:18651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb92a0 00000100:00080000:0.0:1787574714.846184:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574714.846264:0:18651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787574714.846888:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3633:x1874407346911872:12345-0@lo:9:umount.0 Request processed in 701us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574714.846898:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574714.846925:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787574714.846934:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3633:x1874407346912000:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787574714.846952:0:18651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9405 00000100:00080000:0.0:1787574714.846960:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9ca4035be800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787574714.846987:0:18651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1787574714.847089:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3633:x1874407346912000:12345-0@lo:9:umount.0 Request processed in 156us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574714.847095:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1787574714.847178:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be9800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787574714.847187:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787574714.847190:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574714.847195:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346911872:0@lo:9:umount.0 00000100:00080000:0.0:1787574714.847276:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4033de800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787574714.847281:0:3633:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787574714.847283:0:3633:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787574714.847286:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346912000:0@lo:9:umount.0 00000100:00080000:1.0:1787574714.862674:0:3635:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.140@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787574714.862684:0:3635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787574714.862697:0:3635:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503581c00 x1874407346911232/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574730 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574714.862718:0:3635:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53579ea00 x1874407346911488/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574730 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574714.862728:0:3635:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53579df80 x1874407346911616/t0(0) o103->MGC192.168.202.140@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787574730 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787574714.862738:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787574714.862741:0:3635:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787574714.862743:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787574714.862808:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:0:1874407346911360:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1787574714.862892:0:17138:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787574714.863214:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574714.863521:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:0:1874407346911744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574714.863921:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3636:1874407346911232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574714.864306:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787574714.877498:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574714.877519:0:3635:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 545 00000100:00080000:1.0:1787574714.877532:0:3635:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca50500b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574714.877679:0:3635:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f6300 x1874407346912128/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574714.877744:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346911488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574714.877770:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3635:1874407346911616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787574714.877841:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346912128:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1787574714.877892:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346912128 offset 0 length 520: 4 00000020:00080000:3.0:1787574714.883754:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9ca52eeacd28) has no exports 00000020:01000000:1.0:1787574714.932769:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca40320cae0 - data ffff9ca527430870/ffff9ca4042d4000 00000020:01000000:1.0:1787574714.932964:0:20921:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca541497ea0 - data ffff9ca5276f2e58/ffff9ca52e6b6000 00000001:00000004:1.0:1787574714.944515:0:20921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1787574714.990996:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574714.991005:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787574714.991013:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1787574714.995807:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787574714.995816:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787574714.995835:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787574714.995838:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787574714.996933:0:17884:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787574714.996940:0:17884:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787574714.996963:0:17884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1787574714.998642:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787574714.998649:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1787574714.998658:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787574714.998661:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787574714.999305:0:17886:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787574714.999310:0:17886:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1787574714.999334:0:17886:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1787574715.000298:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb910a 00000020:00000080:2.0:1787574715.000309:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a3b000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787574715.000892:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb911f 00000020:00000080:2.0:1787574715.000899:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a38800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787574715.000903:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1787574715.000909:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574715.000917:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787574715.000921:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ca52eea8000) has no exports 00000004:01000000:2.0:1787574715.001069:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787574715.001087:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9173 00000020:00000080:2.0:1787574715.001092:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca536bef000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787574715.001096:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787574715.001100:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574715.001104:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787574715.001107:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9ca5350b99b8) has no exports 00000020:00000080:2.0:1787574715.001113:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb916c 00000020:00000080:2.0:1787574715.001116:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca4033de000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1787574715.001462:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787574715.001467:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787574715.001472:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787574715.001477:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787574715.001479:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574715.001505:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574715.001511:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787574715.001516:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb915e 00000020:00000080:2.0:1787574715.001520:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca536beb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787574715.001524:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1787574715.001527:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574715.001529:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787574715.001531:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9ca52eeab370) has no exports 00000020:00000080:2.0:1787574715.001534:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9157 00000020:00000080:2.0:1787574715.001536:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca536be8800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1787574715.001836:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1787574715.001839:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787574715.001841:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1787574715.001845:0:20921:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787574715.001847:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574715.001879:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574715.001884:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1787574715.001892:0:20921:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1787574715.001897:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9142 00000020:00000080:2.0:1787574715.001908:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca536bed000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1787574715.001913:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1787574715.001915:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574715.001919:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787574715.001921:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9ca4024c8000) has no exports 00000020:00000080:2.0:1787574715.001925:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb913b 00000020:00000080:2.0:1787574715.001927:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a3a800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787574715.002854:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787574715.002865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a38800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1787574715.002870:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787574715.002874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033de000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787574715.002880:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4033de800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1787574715.002886:0:36:0:(genops.c:885:class_export_put()) final put ffff9ca536bef800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787574715.002888:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bef800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1787574715.002892:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574715.002971:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536beb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787574715.002976:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536be8800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787574715.002980:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca536be9800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1787574715.002983:0:36:0:(genops.c:885:class_export_put()) final put ffff9ca536bee800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787574715.002985:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bee800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1787574715.002988:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574715.003012:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca536bed000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787574715.003016:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1787574715.003354:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1787574715.003360:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787574715.003364:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787574715.003369:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574715.003410:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574715.003418:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787574715.003445:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574715.003449:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787574715.003453:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca50c26c000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574715.003456:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50c26c000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787574715.003464:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574715.003624:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca534a3d800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1787574715.003632:0:36:0:(genops.c:885:class_export_put()) final put ffff9ca506ef2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787574715.003634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca506ef2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1787574715.003637:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787574715.003746:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9126 00000020:00000080:3.0:1787574715.003753:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a3f000/lustre-MDD0001_UUID 00000020:01000000:3.0:1787574715.003762:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1787574715.003766:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574715.003770:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787574715.003774:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ca52eea99b8) has no exports 00000020:00000080:3.0:1787574715.003792:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574715.003795:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1787574715.003809:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb912d 00000020:00000080:3.0:1787574715.003813:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a3e000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1787574715.003820:0:20921:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca4033ba000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1787574715.003824:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca4033ba000 2 00000020:01000004:3.0:1787574715.003827:0:20921:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca4033ba000 from lustre-MDT0001 00000020:00000080:3.0:1787574715.003844:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574715.003847:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1787574715.003850:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca534a39000/lustre-MDT0001_UUID 00000020:00000080:3.0:1787574715.003852:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a39000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1787574715.003858:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1787574715.003884:0:20921:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1787574715.003888:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1787574715.003890:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574715.003893:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787574715.003899:0:20921:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9ca402708800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574715.003904:0:20921:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9ca52e6f19b8) has exports, disconnecting them 00000020:00080000:3.0:1787574715.003908:0:20921:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9ca402708800), last request at 1787574622 00000020:00000080:3.0:1787574715.003911:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb91ab 00000020:00080000:3.0:1787574715.003921:0:20921:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca402708800): rc 0 00000020:00000080:3.0:1787574715.003924:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca402708800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787574715.004863:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1787574715.004870:0:36:0:(genops.c:885:class_export_put()) final put ffff9ca534a3c000/lustre-MDD0001_UUID 00000020:00000080:1.0:1787574715.004872:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1787574715.004876:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787574715.004974:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca534a3e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787574715.004978:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca402708800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1787574715.097383:0:20921:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1787574715.097393:0:20921:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574715.097398:0:20921:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787574715.097405:0:20921:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787574715.097441:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca40270c000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1787574715.097638:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574715.097647:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1787574715.097653:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca53be10000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1787574715.097656:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53be10000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1787574715.097670:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787574715.097741:0:20921:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca4033ba000 1 00000020:00000080:1.0:1787574715.097748:0:20921:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb90d2 00000020:00000080:1.0:1787574715.097755:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca50309a800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787574715.097765:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787574715.097773:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50309a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1787574715.097783:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574715.097787:0:20921:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574715.097790:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9ca402223370) has no exports 00000020:00000080:1.0:1787574715.275383:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787574715.275397:0:20921:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1787574715.275403:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca4033b9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1787574715.275408:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4033b9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1787574715.275420:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1787574715.275543:0:20921:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca4033bc800 00000020:01000000:1.0:1787574715.279150:0:20921:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787574715.279161:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574715.279167:0:20921:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574715.279172:0:20921:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9ca4032c99b8) has no exports 00000100:00100000:0.0:1787574715.283230:0:17144:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9ca402211e00:17144] 1 exiting: rc = 0 00000100:00100000:0.0:1787574715.283407:0:19986:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9ca404431800:19986] 3 exiting: rc = 0 00000100:00100000:3.0:1787574715.285696:0:17142:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9ca4019dda00:17142] 0 exiting: rc = 1 00000100:00100000:1.0:1787574715.285718:0:20285:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9ca40359d200:20285] 4 exiting: rc = 0 00000100:00100000:2.0:1787574715.285882:0:17145:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9ca4020cb000:17145] 2 exiting: rc = 0 00000100:00100000:2.0:1787574715.286078:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286087:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286093:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286099:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286107:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286114:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286130:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286136:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286142:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286147:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286153:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286158:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286163:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286168:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286173:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286178:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286184:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286189:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286195:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286202:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286206:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286212:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286217:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286223:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286228:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286234:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286293:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286299:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286304:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286311:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286317:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286322:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286327:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286333:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286339:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286344:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286350:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286357:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286362:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286367:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286373:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286381:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286482:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286493:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286499:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286505:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286509:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286514:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286519:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286524:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286530:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286535:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286540:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286547:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286552:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286558:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286567:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286574:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286582:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286589:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286596:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286612:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286617:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.286623:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.299305:0:17147:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9ca509b30a00:17147] 1 exiting: rc = 0 00000100:00100000:3.0:1787574715.304227:0:17146:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9ca509b31800:17146] 0 exiting: rc = 1 00000100:00100000:1.0:1787574715.304317:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304328:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304338:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304349:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304355:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304360:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304364:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304370:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304375:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304380:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304385:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304390:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304395:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304401:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304407:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304413:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304418:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304424:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304430:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304435:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304440:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304445:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304450:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304455:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304460:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304466:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304471:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304476:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304481:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304486:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304491:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304497:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304502:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304507:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304512:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304541:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304626:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304634:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304640:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304898:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304904:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.304909:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305088:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305096:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305101:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305106:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305112:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305126:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305133:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305137:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305142:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305148:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305154:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305160:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305166:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305171:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305176:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305181:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305186:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305191:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305197:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305202:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305207:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.305212:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574715.323522:0:17148:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9ca518695800:17148] 0 exiting: rc = 1 00000100:00100000:2.0:1787574715.323667:0:17149:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9ca53b0a5000:17149] 1 exiting: rc = 0 00000100:00100000:0.0:1787574715.323872:0:18100:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9ca4024f6200:18100] 2 exiting: rc = 0 00000100:00100000:1.0:1787574715.323980:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.323991:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.323997:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324003:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324016:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324023:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324044:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324050:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324056:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324062:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324067:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324073:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324079:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324084:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324090:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324096:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324127:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324136:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324141:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324147:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324152:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324158:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324164:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324170:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324176:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324182:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324187:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324193:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324213:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324221:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324227:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324233:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324292:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324299:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324307:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324315:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324324:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324331:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324337:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324344:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.324367:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325430:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325436:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325442:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325449:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325456:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325462:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325469:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325474:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325481:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325487:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325494:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325521:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325530:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325535:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325555:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325562:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325568:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325573:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325579:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325585:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325594:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325600:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.325606:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.346004:0:17150:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9ca53b0a4e00:17150] 0 exiting: rc = 1 00000100:00100000:3.0:1787574715.347588:0:17151:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9ca53b0a4600:17151] 1 exiting: rc = 0 00000100:00100000:0.0:1787574715.347780:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347788:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347794:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347812:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347817:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347823:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347829:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347834:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347840:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347846:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347852:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347858:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347863:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347868:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347873:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347878:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347883:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347888:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347893:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347899:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347903:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347910:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347915:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347920:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347925:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347931:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347936:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347941:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347947:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347952:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347958:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347963:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347968:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347973:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347978:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347983:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347988:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.347993:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348008:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348013:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348019:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348024:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348029:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348049:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348054:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348060:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348065:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348070:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348075:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348080:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348084:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348089:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348094:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348100:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348105:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348111:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348127:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348133:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348139:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348144:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348149:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348155:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348160:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.348166:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574715.348551:0:17152:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9ca520543200:17152] 0 exiting: rc = 1 00000100:00100000:1.0:1787574715.348617:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9ca520542400:17153] 1 exiting: rc = 0 00000100:00100000:0.0:1787574715.352191:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352203:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352207:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352212:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352217:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352222:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352227:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352231:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352261:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352280:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352286:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352291:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352296:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352301:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352305:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352310:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352314:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352319:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352324:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352330:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352335:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352340:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352345:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352349:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352354:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352360:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352365:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352370:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352375:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352380:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352385:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352389:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352394:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352400:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352405:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352410:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352415:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352421:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352426:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352430:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352436:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352441:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352446:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352451:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352463:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352468:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352473:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352478:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352483:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352488:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352493:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352498:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352503:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352508:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352514:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352519:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352523:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352528:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352533:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352539:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352543:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352562:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352568:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.352573:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.356907:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9ca53bfe0400:17155] 1 exiting: rc = 0 00000100:00100000:3.0:1787574715.357233:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9ca53bfe1a00:17154] 0 exiting: rc = 1 00000100:00100000:0.0:1787574715.357328:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357340:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357346:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357353:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357384:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357392:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357398:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357403:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357408:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357414:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357419:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357424:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357430:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357436:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357441:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357460:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357465:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357470:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357475:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357480:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357485:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357490:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357495:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357500:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357505:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357511:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357516:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357521:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357527:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357532:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357537:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357542:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357626:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357633:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357638:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357929:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357936:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357941:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357945:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357951:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357956:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357961:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357966:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357971:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357976:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357981:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357986:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357991:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.357996:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358002:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358016:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358022:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358026:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358031:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358036:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358042:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358047:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358053:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358058:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358064:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358070:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358075:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358081:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574715.358086:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.359343:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9ca521851600:17156] 0 exiting: rc = 1 00000100:00100000:0.0:1787574715.359934:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9ca518695000:17158] 2 exiting: rc = 0 00000100:00100000:3.0:1787574715.366064:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9ca521851800:17157] 1 exiting: rc = 0 00000100:00100000:1.0:1787574715.366275:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366285:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366292:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366298:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366305:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366313:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366321:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366328:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366337:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366360:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366366:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366371:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366377:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366384:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366389:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366395:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366401:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366408:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366427:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366434:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366440:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366445:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366452:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366457:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366462:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366469:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366477:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366483:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366489:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366494:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366501:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366506:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366515:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366524:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366532:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366539:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366625:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366633:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366639:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366656:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366662:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366668:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366690:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366697:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366711:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366716:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366722:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366727:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366743:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366751:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366757:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366960:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366970:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366976:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366982:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366987:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366992:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.366998:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367003:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367008:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367014:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367020:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367026:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787574715.367042:0:20921:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787574715.390865:0:20921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574715.390882:0:20921:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787574715.390888:0:20921:0:(genops.c:885:class_export_put()) final put ffff9ca404160800/MDS_uuid 00000020:00000080:2.0:1787574715.390892:0:20921:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca404160800/MDS_uuid for MDS 00000020:01000000:2.0:1787574715.390904:0:20921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787574715.391095:0:20921:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1787574715.634456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574715.634467:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574715.634470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574715.634474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787574715.634478:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574715.634489:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 649 00000100:00080000:0.0:1787574715.634496:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787574715.634503:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca5109bb000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574715.634545:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d67480 x1874407346912256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574715.634590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787574715.634593:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787574715.634595:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574715.634598:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 649 00000100:00080000:0.0:1787574715.634614:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787574715.634618:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca4023fe000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574715.634629:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d65180 x1874407346912512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574715.634681:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574715.634697:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346912384:0@lo:400:kworker.0 00000400:00000100:0.0:1787574715.634748:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912384 offset 0 length 224: 4 00000100:00100000:0.0:1787574715.634784:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574715.634792:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346912640:0@lo:400:kworker.0 00000400:00000100:0.0:1787574715.634810:0:3635:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912640 offset 0 length 224: 4 00000100:00100000:3.0:1787574715.634867:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346912256:0@lo:38:kworker.0 00000400:00000100:3.0:1787574715.634891:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912256 offset 0 length 520: 4 00000100:00100000:3.0:1787574715.634903:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346912512:0@lo:38:kworker.0 00000400:00000100:3.0:1787574715.634927:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912512 offset 0 length 520: 4 00010000:00010000:1.0:1787574715.765480:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574716.787371:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574717.809648:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574718.835310:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787574719.669203:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574719.669217:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574719.669220:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574719.669224:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574719.669313:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787574719.669317:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574719.669360:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574719.669381:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346912768:0@lo:400:kworker.0 00000400:00000100:1.0:1787574719.669453:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912768 offset 0 length 224: 4 00000100:00100000:1.0:1787574719.669530:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346912896:0@lo:400:kworker.0 00000400:00000100:1.0:1787574719.669552:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346912896 offset 0 length 224: 4 00010000:00010000:1.0:1787574719.858006:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787574720.041196:0:21123:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1787574720.058356:0:21123:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787574720.058439:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574720.059880:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574720.059891:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574720.059899:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574720.059937:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787574720.059945:0:21123:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787574720.059986:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574720.060002:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca502d67480 x1874407346912256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574720.060022:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787574720.060030:0:21123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787574720.060038:0:21123:0:(import.c:65:import_set_state_nolock()) ffff9ca5109bb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1787574720.060046:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787574720.060049:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca502d67480 x1874407346912256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574720.060057:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574720.060091:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787574720.060622:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574720.060631:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574720.060642:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca502fab000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574720.060646:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574720.060657:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574720.060666:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574720.060675:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574720.060686:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787574720.060690:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787574720.060708:0:17132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:0.0:1787574720.060713:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574720.060772:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346912256:0@lo:38:kworker.0 00010000:00010000:0.0:1787574720.061591:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502fab000/0xd18a1efeeddb9245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb924c expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787574720.063033:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787574720.063054:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca502d65500 x1874407346912384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574731 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574720.063090:0:21123:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53579dc00 x1874407346912768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574720.063112:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1787574720.070169:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574720.070181:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574720.070185:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787574720.070274:0:21123:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787574720.070323:0:21123:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fc800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787574720.073171:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346913024:0@lo:39:umount.0 00000400:00000100:0.0:1787574720.073287:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346913024 offset 0 length 224: 4 00000100:00100000:1.0:1787574720.075798:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346912768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574720.079383:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346912384:0@lo:400:kworker.0 00000100:00080000:3.0:1787574720.689907:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574720.689917:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574720.689920:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574720.689924:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574720.690053:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574720.690101:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346913152:0@lo:400:kworker.0 00000400:00000100:2.0:1787574720.690156:0:3636:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346913152 offset 0 length 224: 4 00000001:00100000:3.0:1787574720.771303:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574720.771317:0:18646:0:(genops.c:885:class_export_put()) final put ffff9ca5350a1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787574720.772339:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787574720.772397:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5350a2000 for lustre-OST0000 00000001:00100000:2.0:1787574720.772919:0:19464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787574720.772924:0:19464:0:(genops.c:885:class_export_put()) final put ffff9ca4035ba800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787574720.773371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4035ba800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787574720.773405:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4035be800 for lustre-OST0001 00010000:00010000:0.0:1787574720.881496:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574721.905653:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574722.929576:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574723.956006:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574724.145397:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574714/real 1787574714] req@ffff9ca53f4f6300 x1874407346912128/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574724 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574724.145436:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53f4f6300 x1874407346912128/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787574724 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574724.145457:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574724.145486:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787574724.145490:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346912128:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1787574724.145615:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574724.145620:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787574724.145623:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574724.145629:0:36:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 654 00000100:00080000:2.0:1787574724.145634:0:36:0:(import.c:589:import_select_connection()) MGC192.168.202.140@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787574724.145642:0:36:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca50500b800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574724.145673:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f5f80 x1874407346913280/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574724.145715:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787574724.145720:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787574724.146075:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346913280:0@lo:250:kworker.0 00000400:00000100:0.0:1787574724.146124:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874407346913280 offset 0 length 520: 4 00000100:00100000:1.0:1787574724.146260:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346913408:0@lo:400:kworker.0 00000400:00000100:1.0:1787574724.146289:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346913408 offset 0 length 224: 4 00010000:00010000:0.0:1787574724.979005:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574726.001386:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574727.025467:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574728.049477:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574729.073618:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574729.459216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574729.459227:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574729.459230:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574729.459233:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574729.459473:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574729.459496:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346913536:0@lo:400:kworker.0 00000400:00000100:1.0:1787574729.459571:0:3634:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346913536 offset 0 length 224: 4 00010000:00010000:1.0:1787574730.097836:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574730.289378:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574720/real 1787574720] req@ffff9ca502d67b80 x1874407346913024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574730 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574730.289414:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca502d67b80 x1874407346913024/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574730 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574730.289432:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fc800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787574730.289457:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346913024:0@lo:39:umount.0 00000100:00080000:1.0:1787574730.289553:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787574730.289557:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787574730.289563:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787574730.290411:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290426:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290433:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290439:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290483:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574730.290492:0:21123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290500:0:21123:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290506:0:21123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290512:0:21123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574730.290539:0:21123:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1787574730.290544:0:21123:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1787574730.290570:0:21123:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1787574730.290575:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1787574730.290579:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787574730.290585:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787574730.290590:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ca5350bcd28) has no exports 00000020:00080000:1.0:1787574730.290614:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9ca5350bcd28) has no exports 00010000:00010000:2.0:1787574730.290620:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574730.290628:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290637:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574730.290641:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290651:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574730.290659:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574730.290666:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787574730.290668:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787574730.290671:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787574730.290686:0:17132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:2.0:1787574730.290690:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290697:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74600/0xd18a1efeeddb921b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9222 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290710:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574730.290714:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290727:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca500031e00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574730.290730:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290737:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574730.290744:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574730.290748:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787574730.290751:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787574730.290752:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787574730.290758:0:17132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:2.0:1787574730.290762:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290768:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca500031e00/0xd18a1efeeddb957f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9586 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574730.290778:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574730.290780:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574730.290782:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787574730.292211:0:21123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca5103e4720 - data ffff9ca527478bd0/ffff9ca52efc4800 00000020:01000000:1.0:1787574730.292368:0:21123:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca40320c300 - data ffff9ca5275431b0/ffff9ca52edb3000 00010000:00010000:0.0:1787574730.292720:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1787574730.306048:0:21123:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787574730.325112:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9230 00000020:00000080:3.0:1787574730.325125:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca5350a4800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787574730.325138:0:21123:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53be15800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787574730.325142:0:21123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53be15800 2 00000020:01000004:3.0:1787574730.325146:0:21123:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca53be15800 from lustre-OST0000 00000020:00000080:3.0:1787574730.325173:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574730.325183:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787574730.325185:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca5350a7800/lustre-OST0000_UUID 00000020:00000080:3.0:1787574730.325188:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a7800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787574730.325195:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787574730.325265:0:21123:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787574730.325270:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787574730.325273:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574730.325290:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787574730.325296:0:21123:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ca5350a5000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787574730.325303:0:21123:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff9ca52e6f0000) has exports, disconnecting them 00000020:00080000:3.0:1787574730.325307:0:21123:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ca5350a5000), last request at 1787574642 00000020:00000080:3.0:1787574730.325311:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb925a 00000020:00080000:3.0:1787574730.325320:0:21123:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350a5000): rc 0 00000020:00000080:3.0:1787574730.325326:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca5350a5000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787574730.325991:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787574730.326005:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350a5000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787574730.326029:0:21123:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787574730.326034:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574730.326038:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787574730.326050:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574730.326068:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca5109bb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787574730.326188:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574730.326194:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1787574730.326198:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca52675b800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787574730.326200:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787574730.326204:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787574730.326261:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787574730.326264:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574730.326268:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787574730.326272:0:21123:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9ca4023fd000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787574730.326277:0:21123:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff9ca52f334d28) has exports, disconnecting them 00000020:00080000:2.0:1787574730.326280:0:21123:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9ca4023fd000), last request at 1787574642 00000020:00000080:2.0:1787574730.326283:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb926f 00000020:00080000:2.0:1787574730.326292:0:21123:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca4023fd000): rc 0 00000020:00000080:2.0:1787574730.326295:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca4023fd000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787574730.326319:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4023fd000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787574730.354331:0:21123:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787574730.354340:0:21123:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787574730.354344:0:21123:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787574730.354351:0:21123:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787574730.354545:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574730.354553:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787574730.354559:0:21123:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53be15800 1 00000020:00000080:0.0:1787574730.354566:0:21123:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb920d 00000020:00000080:0.0:1787574730.354574:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca52675f000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787574730.354579:0:21123:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787574730.354584:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574730.354589:0:21123:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787574730.354592:0:21123:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff9ca52e6f3370) has no exports 00000020:00000080:2.0:1787574730.364164:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4023fc800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1787574730.364180:0:36:0:(genops.c:885:class_export_put()) final put ffff9ca5205a9000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1787574730.364184:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5205a9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1787574730.364198:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1787574730.369936:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787574730.391601:0:21123:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574730.391621:0:21123:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787574730.391629:0:21123:0:(genops.c:885:class_export_put()) final put ffff9ca53be12000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787574730.391634:0:21123:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53be12000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787574730.391648:0:21123:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787574730.391799:0:21123:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca53be16800 00000020:02000400:0.0:1787574730.391858:0:21123:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1787574731.127051:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1787574731.827660:0:3635:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574715/real 1787574715] req@ffff9ca502d64e00 x1874407346912640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574731 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574731.844723:0:3635:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9ca502d64e00 x1874407346912640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787574731 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787574731.844739:0:3635:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45c000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787574731.844743:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787574731.866472:0:3635:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787574731.866529:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574731.866535:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574731.866538:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574731.866541:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574731.866543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787574731.866546:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787574731.866550:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45c000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574731.866558:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 598 00000100:00080000:3.0:1787574731.866567:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ca53f45c000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574731.866610:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503580000 x1874407346913664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574731.867742:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346913664:0@lo:38:kworker.0 00000400:00000100:3.0:1787574731.867796:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874407346913664 offset 0 length 520: 4 00000100:00100000:3.0:1787574731.867867:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346912640:0@lo:400:kworker.0 00010000:00010000:1.0:1787574732.146607:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574733.169499:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574734.193528:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787574734.718692:0:21325:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1787574734.749521:0:21325:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787574734.749624:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.749653:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.749660:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.749667:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.749693:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787574734.749699:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787574734.749721:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574734.749731:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca502d65180 x1874407346912512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.749753:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787574734.749759:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574734.749765:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9ca4023fe000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787574734.749770:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574734.749773:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca502d65180 x1874407346912512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.749780:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787574734.749783:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1787574734.749971:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346912512:0@lo:38:kworker.0 00010000:00010000:1.0:1787574734.750404:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574734.750412:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574734.750432:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574734.750436:0:17132:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574734.750445:0:17132:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574734.750452:0:17132:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574734.750457:0:17132:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787574734.750459:0:17132:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787574734.750461:0:17132:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787574734.750474:0:17132:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:1.0:1787574734.750478:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574734.750485:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca40409c800/0xd18a1efeeddb93a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb93aa expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574734.750496:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574734.750498:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574734.750500:0:17132:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574734.751454:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787574734.751465:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53579f480 x1874407346912896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574735 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751490:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503581180 x1874407346913152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574736 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751513:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53f4f4700 x1874407346913408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574740 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751530:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503582d80 x1874407346913536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574745 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751538:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503580000 x1874407346913664/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787574741 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751552:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787574734.751584:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45c000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574734.751589:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1787574734.751592:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346913664:0@lo:38:kworker.0 00000100:00080000:2.0:1787574734.751617:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787574734.751621:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45c000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787574734.751626:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787574734.751630:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53579f480 x1874407346912896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574735 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751639:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503581180 x1874407346913152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574736 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751646:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53f4f4700 x1874407346913408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574740 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751652:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca503582d80 x1874407346913536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574745 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574734.751658:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787574734.751662:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1787574734.751804:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346913152:0@lo:400:kworker.0 00000100:00100000:3.0:1787574734.751824:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346912896:0@lo:400:kworker.0 00000100:00100000:0.0:1787574734.752200:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346913536:0@lo:400:kworker.0 00000100:00100000:0.0:1787574734.752220:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346913408:0@lo:400:kworker.0 00010000:00010000:2.0:1787574734.753852:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754014:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754022:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754029:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754102:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574734.754110:0:21325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754118:0:21325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754125:0:21325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574734.754132:0:21325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762369:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574734.762395:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762407:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574734.762412:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762422:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574734.762430:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574734.762435:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574734.762437:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1787574734.762452:0:17131:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:0.0:1787574734.762456:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762484:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb000/0xd18a1efeeddb9379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9380 expref: -99 pid: 19463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762503:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574734.762507:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762513:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574734.762517:0:17131:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762524:0:17131:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574734.762531:0:17131:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574734.762537:0:17131:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787574734.762539:0:17131:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1787574734.762544:0:17131:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:0.0:1787574734.762547:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.762554:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574734.762556:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574734.762559:0:17131:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574734.766032:0:21325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787574734.766048:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be74a00/0xd18a1efeeddb9571 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb9578 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574734.766071:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1787574734.766077:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1787574734.766079:0:21325:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787574734.766134:0:21325:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787574734.766139:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787574734.766146:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574734.766152:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787574734.766158:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9ca52e6f4d28) has no exports 00000020:00080000:2.0:1787574734.766184:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff9ca52e6f4d28) has no exports 00010000:00010000:1.0:1787574734.772052:0:20719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787574734.772720:0:21325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca4030998a0 - data ffff9ca527593a20/ffff9ca4030f4c00 00000020:01000000:2.0:1787574734.773135:0:21325:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ca40320cc60 - data ffff9ca5274055e8/ffff9ca52e6c8800 00100000:10000000:2.0:1787574734.784073:0:21325:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787574734.801772:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb938e 00000020:00000080:0.0:1787574734.801784:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca5109b9800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787574734.801802:0:21325:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca510a59000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787574734.801814:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca510a59000 2 00000020:01000004:0.0:1787574734.801818:0:21325:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ca510a59000 from lustre-OST0001 00000020:00000080:0.0:1787574734.801844:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574734.801854:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787574734.801857:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca5109bf000/lustre-OST0001_UUID 00000020:00000080:0.0:1787574734.801860:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5109bf000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787574734.801868:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787574734.801966:0:21325:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c736e7c1-73c2-4d34-bc3f-9b57260ebf6b->MGS 00010000:00010000:0.0:1787574734.801982:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574734.801995:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574734.802001:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787574734.802004:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787574734.802008:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787574734.802021:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:0.0:1787574734.802026:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca509e19600/0xd18a1efeeddb90d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb90e0 expref: -99 pid: 17875 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574734.802041:0:21325:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574734.802048:0:21325:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574734.802054:0:21325:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787574734.802056:0:21325:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787574734.802058:0:21325:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787574734.802065:0:21325:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9ca50500b800 00010000:00010000:0.0:1787574734.802068:0:21325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca502faaa00/0xd18a1efeeddb8fc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd18a1efeeddb8fcf expref: -99 pid: 17122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787574734.802091:0:21325:0:(import.c:65:import_set_state_nolock()) ffff9ca50500b800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787574734.802095:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787574734.802097:0:21325:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787574734.802099:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787574734.802102:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787574734.802113:0:21325:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ca53f4f5f80 x1874407346913280/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787574739 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787574734.802126:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574734.802129:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:2.0:1787574734.802273:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5109b9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1787574734.802303:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c736e7c1-73c2-4d34-bc3f-9b57260ebf6b:3633:1874407346913280:0@lo:250:kworker.0 10000000:01000000:0.0:1787574734.802368:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787574734.802376:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb8fb3 00000020:00000080:0.0:1787574734.802381:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca404165000/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b 00000020:01000000:0.0:1787574734.802395:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.140@tcp (flags='') 00000020:00000080:0.0:1787574734.802400:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574734.802405:0:21325:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.140@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787574734.802408:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9ca4024c99b8) has no exports 10000000:01000000:0.0:1787574734.802440:0:17139:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787574734.802478:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.140@tcp: client import never connected 00000100:00080000:0.0:1787574734.802481:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787574734.802483:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787574734.802485:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787574734.802487:0:21325:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787574734.802514:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787574734.802518:0:21325:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.140@tcp (uuid c736e7c1-73c2-4d34-bc3f-9b57260ebf6b) 00000020:01000000:0.0:1787574734.802523:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787574734.802526:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787574734.802529:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787574734.802534:0:21325:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9ca4023f8800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787574734.802539:0:21325:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff9ca52f333370) has exports, disconnecting them 00000020:00080000:0.0:1787574734.802544:0:21325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9ca4023f8800), last request at 1787574659 00000020:00000080:0.0:1787574734.802553:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb93b8 00000020:00080000:0.0:1787574734.802562:0:21325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca4023f8800): rc 0 00000020:00000080:0.0:1787574734.802566:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca4023f8800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787574734.803314:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca404165000/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b for MGC192.168.202.140@tcp 00000020:00000080:2.0:1787574734.803327:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca50500b800 for MGC192.168.202.140@tcp 00000020:00000080:2.0:1787574734.803333:0:38:0:(genops.c:885:class_export_put()) final put ffff9ca50500c800/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b 00000020:00000080:2.0:1787574734.803335:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca50500c800/c736e7c1-73c2-4d34-bc3f-9b57260ebf6b for MGC192.168.202.140@tcp 00000020:01000000:2.0:1787574734.803338:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.140@tcp (c736e7c1-73c2-4d34-bc3f-9b57260ebf6b) 00000020:00000080:2.0:1787574734.803566:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4023f8800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1787574734.824349:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1787574734.824359:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787574734.824363:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787574734.824371:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787574734.824582:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787574734.824600:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1787574734.824607:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787574734.824616:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787574734.824621:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787574734.824629:0:21325:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9ca5350cd800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787574734.824635:0:21325:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff9ca52f330000) has exports, disconnecting them 00000020:00080000:2.0:1787574734.824650:0:21325:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9ca5350cd800), last request at 1787574659 00000020:00000080:2.0:1787574734.824655:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb93cd 00000020:00080000:2.0:1787574734.824671:0:21325:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ca5350cd800): rc 0 00000020:00000080:2.0:1787574734.824676:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca5350cd800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1787574734.825368:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca4023fe000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787574734.825378:0:38:0:(genops.c:885:class_export_put()) final put ffff9ca53f459800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787574734.825381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca53f459800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787574734.825391:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787574734.825463:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca5350cd800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1787574734.835780:0:21325:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787574734.835790:0:21325:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787574734.835794:0:21325:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787574734.835803:0:21325:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787574734.835835:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ca53f45c000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787574734.838514:0:17132:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1787574734.839723:0:17131:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787574734.842411:0:20719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787574734.846422:0:17127:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9ca401a04400:17127] 1 exiting: rc = 0 00000100:00100000:3.0:1787574734.848986:0:17126:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9ca510e51200:17126] 0 exiting: rc = 1 00000100:00100000:3.0:1787574734.849096:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.849363:0:17128:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9ca4019df800:17128] 0 exiting: rc = 1 00000100:00100000:3.0:1787574734.849427:0:17130:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9ca4019dee00:17130] 2 exiting: rc = 0 00000100:00100000:1.0:1787574734.850489:0:17129:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9ca4019dfe00:17129] 1 exiting: rc = 0 00000100:00100000:2.0:1787574734.850914:0:20172:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9ca4021d5600:20172] 3 exiting: rc = 0 00000100:00100000:3.0:1787574734.856483:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856494:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856501:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856508:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856514:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856532:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856538:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856543:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856548:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856554:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856559:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856564:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856570:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856575:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856580:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856596:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856602:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856608:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856613:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856618:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856624:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856628:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856635:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856640:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856646:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856650:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856655:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856660:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856665:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856671:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856675:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856680:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856685:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856690:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856695:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856701:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856706:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856711:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856715:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856720:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856735:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856740:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856744:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856749:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856754:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856760:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856765:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856770:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856776:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856782:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856788:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856793:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856798:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856803:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856808:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856813:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856819:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856824:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856830:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856835:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856840:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856845:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856851:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574734.856856:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787574734.871390:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574734.871401:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787574734.871408:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca4023ff000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787574734.871412:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4023ff000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787574734.871418:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787574734.871468:0:21325:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca510a59000 1 00000020:00000080:3.0:1787574734.871474:0:21325:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd18a1efeeddb9372 00000020:00000080:3.0:1787574734.871481:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca4023fc000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787574734.871493:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787574734.871505:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca4023fc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787574734.871528:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574734.871534:0:21325:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787574734.871538:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff9ca53b14b370) has no exports 00000020:00000080:3.0:1787574734.997750:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574734.997766:0:21325:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787574734.997772:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca510a5e000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787574734.997776:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca510a5e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787574734.997787:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787574734.998087:0:21325:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ca510a5f000 00000020:01000000:3.0:1787574734.998116:0:21325:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787574734.998121:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787574734.998125:0:21325:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787574734.998129:0:21325:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9ca52f3319b8) has no exports 00000020:00000080:3.0:1787574734.998149:0:21325:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787574734.998154:0:21325:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787574734.998156:0:21325:0:(genops.c:885:class_export_put()) final put ffff9ca52675d800/OSS_uuid 00000020:00000080:3.0:1787574734.998159:0:21325:0:(genops.c:844:class_export_destroy()) destroying export ffff9ca52675d800/OSS_uuid for OSS 00000020:01000000:3.0:1787574734.998162:0:21325:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787574734.998263:0:18650:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9ca503014800:18650] 0 exiting: rc = 1 00000100:00100000:0.0:1787574734.998418:0:18933:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ca402390400:18933] 3 exiting: rc = 0 00000100:00100000:0.0:1787574734.998481:0:18652:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ca4019e9000:18652] 2 exiting: rc = 0 00000100:00100000:0.0:1787574734.998545:0:18651:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ca503014c00:18651] 1 exiting: rc = 0 00000100:00080000:2.0:1787574735.000363:0:17138:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787574735.000599:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000609:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000614:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000619:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000624:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000629:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000634:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000640:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000645:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000651:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000656:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000662:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000667:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000672:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000714:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000724:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000730:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000734:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000740:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000745:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000750:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000755:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000761:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000767:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000772:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000777:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000782:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000788:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000793:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000798:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000803:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000808:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000813:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000818:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000823:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000828:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000833:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000839:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000845:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000850:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000855:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000860:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000866:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000872:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000878:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000883:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000888:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000900:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000906:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000916:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000921:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000926:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000931:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000936:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000951:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000958:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000963:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000968:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000974:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000980:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000985:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000990:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.000995:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787574735.001000:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011196:0:18653:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9ca520268e00:18653] 0 exiting: rc = 1 00000100:00100000:0.0:1787574735.011551:0:18654:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9ca520269000:18654] 1 exiting: rc = 0 00000100:00100000:2.0:1787574735.011702:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011709:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011713:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011722:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011727:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011732:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011737:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011742:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011747:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011752:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011757:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011762:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011768:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011773:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011778:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011783:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011788:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011793:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011798:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011803:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011808:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011813:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011818:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011823:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011829:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011835:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011840:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011864:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011870:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011875:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011880:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011885:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011891:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011896:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011901:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011906:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011911:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011928:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011933:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011938:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011952:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011958:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011963:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011976:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011982:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011987:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.011995:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012004:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012010:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012015:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012021:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012026:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012031:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012035:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012040:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012045:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012050:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012054:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012059:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012063:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012068:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012072:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012084:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.012093:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.013068:0:20287:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9ca5045aac00:20287] 3 exiting: rc = 0 00000100:00100000:3.0:1787574735.013434:0:18656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9ca510164200:18656] 1 exiting: rc = 0 00000100:00100000:3.0:1787574735.013583:0:18657:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9ca510164600:18657] 2 exiting: rc = 0 00000100:00100000:0.0:1787574735.013800:0:18655:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9ca510165800:18655] 0 exiting: rc = 1 00000100:00100000:2.0:1787574735.013984:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.013995:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014002:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014008:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014014:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014021:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014026:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014031:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014037:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014042:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014048:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014055:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014060:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014066:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014072:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014078:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014084:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014089:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014095:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014101:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014106:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014112:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014117:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014123:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014145:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014151:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014157:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014163:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014168:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014174:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014180:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014186:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014203:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014208:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014215:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014220:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014226:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014232:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014336:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014345:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014350:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014356:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014362:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014368:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014374:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014380:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014385:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014391:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014412:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014419:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014425:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014430:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014437:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014442:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014448:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014454:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014460:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014466:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014472:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014479:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014484:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014490:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014497:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.014503:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.028790:0:18658:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9ca5414bfe00:18658] 0 exiting: rc = 1 00000100:00100000:2.0:1787574735.033615:0:18659:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9ca510165e00:18659] 1 exiting: rc = 0 00000100:00100000:0.0:1787574735.034904:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034913:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034919:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034924:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034930:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034935:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034955:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034961:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034966:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034971:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.034976:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035006:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035014:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035019:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035025:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035029:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035035:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035040:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035045:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035050:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035055:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035060:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035081:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035086:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035091:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035095:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035100:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035106:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035162:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035168:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035173:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035178:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035183:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035188:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035193:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035199:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035203:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035208:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035213:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035217:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035221:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035226:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035231:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035236:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035263:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035269:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035274:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035281:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035286:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035291:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035296:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035302:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035307:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035312:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035317:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035322:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035330:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035345:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035351:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035356:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035362:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035366:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035372:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.035379:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787574735.036201:0:18660:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9ca52e66ec00:18660] 0 exiting: rc = 1 00000100:00100000:1.0:1787574735.036387:0:18661:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9ca4024f6000:18661] 1 exiting: rc = 0 00000100:00100000:0.0:1787574735.036550:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036583:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036590:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036596:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036602:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036608:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036615:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036621:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036627:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036633:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036639:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036645:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036651:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036670:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036677:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036683:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036691:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036698:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036703:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036708:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036715:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036720:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036726:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036733:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036739:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036759:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036765:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036773:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036789:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036795:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036800:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036806:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036811:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036818:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036824:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036829:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036835:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036855:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036862:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036867:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036873:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036879:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036885:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036891:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036897:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036903:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036909:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036915:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036921:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036954:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036965:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036971:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036977:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036983:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036989:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.036996:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037003:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037008:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037014:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037022:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037028:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037033:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037040:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787574735.037060:0:21325:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787574735.055053:0:21325:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787574756.060773:0:22091:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787574765.845605:0:22691:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787574765.845636:0:22691:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1787574765.845638:0:22691:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1787574765.845755:0:22691:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca404bb1800 00000020:01000004:0.0:1787574765.845773:0:22691:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787574765.845783:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787574765.845799:0:22691:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9ca5350bcd28) 00000020:00000080:0.0:1787574765.845814:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787574765.948547:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.950738:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787574765.952711:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.953055:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.953292:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.953801:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.954094:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.954343:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.954813:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.955099:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.955534:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.955797:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.956045:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.956400:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.956694:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.956871:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.957363:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.957975:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.958277:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.958596:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.958861:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.959177:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.959656:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.960192:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.961547:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.963002:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.963332:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.964028:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.964275:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.964567:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.964796:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1787574765.965042:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.965288:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.965626:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1787574765.966820:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.969571:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.969821:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.970188:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.970812:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.971138:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.971377:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.971759:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.972040:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.972272:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.972633:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787574765.972865:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1787574765.973098:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.973849:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.974734:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.975029:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.976566:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.977090:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787574765.977707:0:22691:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:2.0:1787574765.978949:0:22691:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787574765.980876:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787574765.980886:0:22691:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574765.980898:0:22691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb9826 00000020:01000004:2.0:1787574765.980906:0:22691:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787574765.980910:0:22691:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787574765.980915:0:22691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca404bb1800 from MGS 00000020:01000004:2.0:1787574765.980919:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787574765.980931:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9ca52e6f0000) 00000020:00000080:2.0:1787574765.980943:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787574765.981302:0:22691:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca404bb1800 from MGS, refs=2 00080000:01000000:2.0:1787574765.981308:0:22691:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574765.981313:0:22691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb9834 00000100:00100000:2.0:1787574765.981423:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787574765.981551:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787574765.981557:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787574765.982473:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787574765.982482:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787574765.983802:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574765.984001:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787574765.984007:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787574765.989303:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787574765.989317:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787574765.990531:0:22691:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787574765.990541:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787574765.991776:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574765.991781:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574765.991783:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574765.992189:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574765.992191:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574765.992193:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574765.993236:0:22691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787574765.995429:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787574766.000862:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1787574766.003421:0:22703:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787574766.003494:0:22691:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787574766.003550:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787574766.005303:0:22691:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787574766.007737:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574766.007934:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787574766.007941:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787574766.013347:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787574766.013362:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787574766.013844:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787574766.013851:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787574766.014730:0:22708:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1787574766.014807:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787574766.014829:0:22691:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.140@tcp' 00000020:01000004:0.0:1787574766.014831:0:22691:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787574766.014861:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.140@tcp (typ=mgc) 00000020:00000080:0.0:1787574766.014873:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.140@tcp (ffff9ca5350b99b8) 00000020:00000080:0.0:1787574766.014888:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787574766.015234:0:22691:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca404bb2800@MGC192.168.202.140@tcp: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574766.015489:0:22691:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.140@tcp-0 is initialized 00000040:01000000:0.0:1787574766.015495:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 1 is initialized 10000000:01000000:0.0:1787574766.029554:0:22709:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787574766.029692:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.140@tcp (uuid 4f82b38c-81e1-4088-8af8-2f43485ff140) 00000020:00000080:1.0:1787574766.029716:0:22691:0:(genops.c:1385:class_connect()) connect: client 4f82b38c-81e1-4088-8af8-2f43485ff140, cookie 0xd18a1efeeddb9842 00000100:00080000:1.0:1787574766.029729:0:22691:0:(import.c:510:import_select_connection()) MGC192.168.202.140@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574766.029735:0:22691:0:(import.c:624:import_select_connection()) MGC192.168.202.140@tcp: import ffff9ca404bb2800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574766.029813:0:22691:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579dc00 x1874407346913792/t0(0) o250->MGC192.168.202.140@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574766.029844:0:22691:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 4f82b38c-81e1-4088-8af8-2f43485ff140->MGS 00000020:01000004:1.0:1787574766.029863:0:22691:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787574766.029867:0:22691:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787574766.029882:0:22691:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9ca53b1499b8) 00000020:00000080:1.0:1787574766.029894:0:22691:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787574766.030987:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4f82b38c-81e1-4088-8af8-2f43485ff140:3633:1874407346913792:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787574766.031066:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.031207:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346913792 00000100:00100000:0.0:1787574766.031216:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346913792 00000100:00100000:0.0:1787574766.031276:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574766.031285:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3633:x1874407346913792:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787574766.031310:0:22705:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4f82b38c-81e1-4088-8af8-2f43485ff140@0@lo t0 exp 0000000000000000 cur 705 last 0 00000020:00000080:0.0:1787574766.031348:0:22705:0:(genops.c:1385:class_connect()) connect: client 4f82b38c-81e1-4088-8af8-2f43485ff140, cookie 0xd18a1efeeddb9850 00000100:00080000:0.0:1787574766.031488:0:22705:0:(import.c:65:import_set_state_nolock()) ffff9ca404bb0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574766.031562:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+5:3633:x1874407346913792:12345-0@lo:250:mount.lustre.0 Request processed in 276us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574766.031571:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574766.031638:0:3633:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.140@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787574766.031647:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.140@tcp: connect to target with instance 0 00000100:00080000:0.0:1787574766.031653:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.140@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787574766.031658:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787574766.031670:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca404bb2800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787574766.031673:0:3633:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787574766.031682:0:3633:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787574766.031687:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4f82b38c-81e1-4088-8af8-2f43485ff140:3633:1874407346913792:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787574766.044633:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574766.059015:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787574766.059024:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787574766.061855:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787574766.061868:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787574766.062592:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787574766.062601:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787574766.070788:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574766.070982:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787574766.070988:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787574766.079014:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787574766.079029:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787574766.119475:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574766.120092:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787574766.120099:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787574766.122467:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787574766.122484:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787574766.123539:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574766.123809:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787574766.123816:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787574766.124515:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787574766.124528:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787574766.125057:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574766.125488:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787574766.125496:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787574766.126004:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787574766.126012:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787574766.126750:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787574766.126906:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787574766.126912:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787574766.134528:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787574766.134540:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787574766.164084:0:22691:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574766.164306:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574766.164313:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787574766.186030:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787574766.186050:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787574766.195424:0:22691:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787574766.195440:0:22691:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787574766.197505:0:22691:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787574766.197534:0:22691:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1787574766.197540:0:22691:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787574766.197648:0:22691:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574766.197696:0:22691:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787574766.197700:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574766.197701:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.197703:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.197704:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.197705:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.197706:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.197707:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.197712:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.197714:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.197715:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574766.197718:0:22691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787574766.197719:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574766.197720:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.197721:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.197722:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.197723:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.197724:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.197724:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.197725:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.197726:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.197727:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574766.197752:0:22691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574766.197772:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346913920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574766.197854:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.197896:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52ee36300 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.198092:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346913920 00000100:00100000:3.0:1787574766.198101:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346913920 00000100:00100000:3.0:1787574766.198153:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787574766.198164:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+5:22691:x1874407346913920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787574766.198209:0:22707:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787574766.198213:0:22707:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787574766.198215:0:22707:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787574766.198608:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787574766.199264:0:22707:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:1.0:1787574766.204056:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787574766.204065:0:22728:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1787574766.204068:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787574766.204072:0:22728:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787574766.209355:0:22728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1787574766.209604:0:22707:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787574766.209743:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787574766.213979:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+5:22691:x1874407346913920:12345-0@lo:253:mount.lustre.0 Request processed in 15806us (16114us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.213994:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574766.214273:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346913920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574766.214289:0:22691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574766.214292:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574766.214294:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.214296:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.214297:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.214298:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.214299:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.214300:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.214302:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.214304:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.214305:0:22691:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574766.214325:0:22691:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca404bb1800 from lustre-MDT0000 10000000:01000000:2.0:1787574766.214354:0:22691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787574766.214357:0:22691:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787574766.214361:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9ca5350b99b8 10000000:01000000:2.0:1787574766.214366:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574766.214384:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9ca5350b99b8 from 1 10000000:01000000:2.0:1787574766.214387:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787574766.214424:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.214434:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.214443:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574766.214463:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574766.214497:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.214529:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52ee360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.214721:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914048 00000100:00100000:3.0:1787574766.214728:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914048 00000100:00100000:3.0:1787574766.214806:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574766.214825:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+5:22691:x1874407346914048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574766.214836:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574766.214850:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb985e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9857 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.214871:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb985e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9857 expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.214891:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421faa00/0xd18a1efeeddb985e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9857 expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.214900:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421faa00, rc 0) 00000100:00100000:3.0:1787574766.214946:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+6:22691:x1874407346914048:12345-0@lo:101:mount.lustre.0 Request processed in 133us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.214953:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574766.215022:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574766.215036:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.215045:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.215097:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574766.215124:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.216258:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.216495:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914176 00000100:00100000:2.0:1787574766.216504:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914176 00000100:00100000:2.0:1787574766.216540:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574766.216548:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+6:22691:x1874407346914176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574766.216686:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+6:22691:x1874407346914176:12345-0@lo:501:mount.lustre.0 Request processed in 139us (1561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574766.216693:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787574766.216779:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914176:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787574766.216831:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787574766.216865:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.216874:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574766.216883:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca404bb1800 10000000:01000000:1.0:1787574766.216888:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787574766.216893:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca404bb1800 10000000:01000000:1.0:1787574766.216896:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787574766.216898:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca404bb1800 from 1 10000000:01000000:1.0:1787574766.216901:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787574766.216931:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.216939:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.216948:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.216966:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574766.217000:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.217019:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.217336:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914304 00000100:00100000:2.0:1787574766.217342:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914304 00000100:00100000:2.0:1787574766.217365:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574766.217372:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+6:22691:x1874407346914304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574766.217381:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574766.217396:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb986c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9865 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.217431:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb986c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9865 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.217441:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83400/0xd18a1efeeddb986c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9865 expref: 7 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.217450:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83400, rc 0) 00000100:00100000:2.0:1787574766.217484:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+7:22691:x1874407346914304:12345-0@lo:101:mount.lustre.0 Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.217491:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787574766.217570:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574766.217583:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb986c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.217592:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb986c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574766.217626:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787574766.217641:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb986c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.217648:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75400/0xd18a1efeeddb9865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb986c expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574766.217655:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787574766.217669:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574766.217674:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca404bb1800 10000000:01000000:1.0:1787574766.217677:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787574766.217680:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787574766.217682:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787574766.217697:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.217705:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.217712:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.217726:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574766.217754:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.217772:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.218319:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914432 00000100:00100000:2.0:1787574766.218325:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914432 00000100:00100000:2.0:1787574766.218347:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574766.218354:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+7:22691:x1874407346914432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574766.218362:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574766.218371:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb987a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9873 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.218386:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb987a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9873 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.218396:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82200/0xd18a1efeeddb987a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9873 expref: 8 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.218403:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82200, rc 0) 00000100:00100000:2.0:1787574766.218437:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+8:22691:x1874407346914432:12345-0@lo:101:mount.lustre.0 Request processed in 83us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.218443:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574766.218636:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574766.218650:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb987a expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.218676:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb987a expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.218737:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574766.218766:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.218798:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.218990:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914560 00000100:00100000:2.0:1787574766.218995:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914560 00000100:00100000:2.0:1787574766.219014:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574766.219020:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+8:22691:x1874407346914560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574766.219145:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22691:x1874407346914560:12345-0@lo:501:mount.lustre.0 Request processed in 125us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.219152:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574766.219214:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574766.219275:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574766.219314:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.219330:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.219400:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914688 00000100:00100000:2.0:1787574766.219404:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914688 00000100:00100000:2.0:1787574766.219422:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787574766.219427:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22691:x1874407346914688:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574766.220341:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22691:x1874407346914688:12345-0@lo:503:mount.lustre.0 Request processed in 908us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.220350:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574766.220466:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346914688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574766.221053:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22729:1874407346914816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574766.221099:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.221138:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51017e180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.221188:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914816 00000100:00100000:2.0:1787574766.221194:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914816 00000100:00100000:2.0:1787574766.221219:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574766.221226:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22729:x1874407346914816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.222480:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22729:x1874407346914816:12345-0@lo:502:llog_process_th.0 Request processed in 1249us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.222493:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787574766.223033:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22729:1874407346914816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574766.223067:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574766.223078:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.223080:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787574766.223085:0:22729:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787574766.223088:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574766.223103:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9ca53b14b370) 00000020:00000080:1.0:1787574766.223121:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787574766.223128:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787574766.223210:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787574766.223218:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb9888 00000020:00000080:2.0:1787574766.224516:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787574766.224527:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574766.224532:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574766.224535:0:22729:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787574766.224538:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574766.224543:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574766.224544:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787574766.224558:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574766.224570:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9ca52e6f4d28) 00000020:00000080:2.0:1787574766.225989:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787574766.226005:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787574766.226008:0:22729:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787574766.226011:0:22729:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787574766.226018:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574766.226121:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca404bb1800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787574766.226139:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9ca52e6f3370) 00000020:00000080:2.0:1787574766.226149:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787574766.226204:0:22729:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787574766.226210:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb989d 00000020:00000080:2.0:1787574766.226359:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787574766.226365:0:22729:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787574766.226370:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd18a1efeeddb98a4 00080000:01000000:2.0:1787574766.226376:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787574766.226380:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb98ab 00010000:00010000:2.0:1787574766.306234:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787574766.307527:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:2.0:1787574766.308925:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787574766.309455:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9ca52e6f19b8) 00000020:00000080:2.0:1787574766.309473:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787574766.309561:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787574766.309569:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb98b9 00000020:00000080:0.0:1787574766.314383:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787574766.319504:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd18a1efeeddb98c0 00000020:00000080:0.0:1787574766.320548:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787574766.320561:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.320569:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.320582:0:22729:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787574766.320586:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787574766.320590:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1787574766.320591:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574766.320593:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574766.320594:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787574766.320597:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.320598:0:22729:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787574766.320601:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.320606:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.320607:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787574766.320620:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787574766.320671:0:22729:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787574766.320686:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.320690:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.320699:0:22729:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787574766.320703:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.320707:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.320708:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1787574766.320711:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787574766.320718:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:0.0:1787574766.320749:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574766.320765:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9ca5350bb370) 00000020:00000080:0.0:1787574766.320782:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1787574766.320790:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787574766.320851:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1787574766.320857:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787574766.320863:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb98ce 00010000:00080000:0.0:1787574766.320898:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca5109ba800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574766.322607:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1787574766.324381:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574766.324398:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1787574766.324434:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574766.324455:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb98d5 00000100:00080000:1.0:1787574766.324466:0:22729:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574766.324471:0:22729:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca5109ba800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574766.324509:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579d500 x1874407346914944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574766.324532:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1787574766.324597:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574766.324602:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.324603:0:22729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1787574766.324606:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574766.324609:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1787574766.324751:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574766.324754:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574766.324756:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574766.324760:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.324761:0:22729:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574766.324765:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574766.324770:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787574766.324774:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.324776:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787574766.324779:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574766.324783:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1787574766.324810:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787574766.324813:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574766.324825:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ca53b14cd28) 00000020:00000080:1.0:1787574766.324837:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787574766.324843:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574766.324903:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787574766.324919:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787574766.324925:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb98e3 00010000:00080000:1.0:1787574766.324955:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca51ebea000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574766.325186:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1787574766.325766:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346914944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574766.325839:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.326204:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346914944 00000100:00100000:1.0:1787574766.326212:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346914944 00000100:00100000:1.0:1787574766.326407:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574766.326415:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346914944:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1787574766.326433:0:22716:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1787574766.329845:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787574766.330045:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787574766.331788:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574766.334364:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787574766.334747:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1787574766.338491:0:22735:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787574766.338501:0:22735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1787574766.344126:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3633:x1874407346914944:12345-0@lo:38:llog_process_th.0 Request processed in 17702us (18279us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574766.344142:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787574766.344879:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574766.344885:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787574766.344890:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346914944:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1787574766.345809:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574766.345825:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574766.345867:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787574766.345887:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb98ea 00000100:00080000:1.0:1787574766.345896:0:22729:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574766.345901:0:22729:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebea000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574766.345937:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579d500 x1874407346915072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574766.345968:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787574766.346020:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574766.346025:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.346026:0:22729:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787574766.346038:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574766.346041:0:22729:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1787574766.346042:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574766.346044:0:22729:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574766.346045:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574766.346047:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.346049:0:22729:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574766.346051:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574766.346055:0:22729:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1787574766.346058:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.346059:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787574766.346062:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574766.346066:0:22729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1787574766.346089:0:22729:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787574766.346091:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574766.346103:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ca53b148000) 00000020:00000080:1.0:1787574766.346114:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1787574766.346118:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574766.346174:0:22729:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787574766.346179:0:22729:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1787574766.346184:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd18a1efeeddb98f8 00010000:00080000:1.0:1787574766.346213:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca51ebec800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574766.346458:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787574766.346527:0:22729:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787574766.346542:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1787574766.346779:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346915072:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787574766.346840:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346915072 offset 0 length 520: 4 00000040:00080000:1.0:1787574766.348852:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574766.349059:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787574766.349206:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1787574766.349796:0:22737:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787574766.349801:0:22737:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787574766.350778:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787574766.350792:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574766.350832:0:22729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574766.350851:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb98ff 00000100:00080000:1.0:1787574766.350861:0:22729:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574766.350875:0:22729:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca51ebec800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574766.350920:0:22729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579d180 x1874407346915200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574766.350980:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346915200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787574766.351039:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346915200 offset 0 length 520: 4 00000100:00080000:1.0:1787574766.351093:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787574766.351154:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574766.351157:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.351159:0:22729:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787574766.351162:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574766.351166:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.351167:0:22729:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574766.351170:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574766.351171:0:22729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574766.351174:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574766.351176:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.351177:0:22729:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574766.351179:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574766.351181:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.351182:0:22729:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574766.351185:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787574766.351214:0:22729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22729:1874407346915328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574766.351291:0:22729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.351312:0:22729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.351524:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915328 00000100:00100000:2.0:1787574766.351532:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915328 00000100:00100000:2.0:1787574766.351741:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574766.351751:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22729:x1874407346915328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.351880:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22729:x1874407346915328:12345-0@lo:502:llog_process_th.0 Request processed in 129us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.351888:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574766.351968:0:22729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22729:1874407346915328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787574766.351993:0:22729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574766.351998:0:22729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574766.352000:0:22729:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574766.352003:0:22729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1787574766.352155:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1787574766.352174:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787574766.352195:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb987a expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.352207:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75800/0xd18a1efeeddb9873 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb987a expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574766.352215:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca404bb1800 from 1 10000000:01000000:0.0:1787574766.352218:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787574766.352275:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.352283:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.352301:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574766.352318:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574766.352351:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.352554:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.352695:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915456 00000100:00100000:3.0:1787574766.352701:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915456 00000100:00100000:3.0:1787574766.352729:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574766.352737:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+9:22691:x1874407346915456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574766.352746:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574766.352760:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9906 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.352781:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.352790:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 10 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.352798:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb600, rc 0) 00000100:00100000:3.0:1787574766.352839:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+10:22691:x1874407346915456:12345-0@lo:101:mount.lustre.0 Request processed in 103us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.352854:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574766.352998:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574766.353010:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.353019:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574766.353609:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915584:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787574766.353784:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.353809:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.353920:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915584 00000100:00100000:3.0:1787574766.353925:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915584 00000100:00100000:3.0:1787574766.353950:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574766.353957:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+10:22691:x1874407346915584:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787574766.353971:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787574766.353978:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787574766.354048:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+10:22691:x1874407346915584:12345-0@lo:256:mount.lustre.0 Request processed in 91us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.354055:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574766.354170:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915584:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787574766.354917:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787574766.354938:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.354948:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574766.354956:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca404bb1800 from 1 10000000:01000000:0.0:1787574766.354958:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574766.354994:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.355002:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574766.355011:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574766.355026:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574766.355063:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.355139:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.355332:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915712 00000100:00100000:1.0:1787574766.355339:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915712 00000100:00100000:3.0:1787574766.355414:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574766.355482:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+10:22691:x1874407346915712:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574766.355493:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574766.355507:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9914 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.355527:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.355537:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.355545:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83c00, rc 0) 00000100:00100000:2.0:1787574766.355595:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346915712:12345-0@lo:101:mount.lustre.0 Request processed in 174us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.355602:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574766.355781:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574766.355793:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.355801:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574766.355857:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915840:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574766.355880:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574766.355905:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.355979:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915840 00000100:00100000:2.0:1787574766.355983:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915840 00000100:00100000:2.0:1787574766.356011:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574766.356018:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346915840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574766.356179:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346915840:12345-0@lo:501:mount.lustre.0 Request processed in 160us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.356186:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787574766.356444:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574766.356475:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574766.356514:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.356570:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646240 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.356743:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346915968 00000100:00100000:3.0:1787574766.356747:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346915968 00000100:00100000:3.0:1787574766.356802:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574766.356809:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346915968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574766.356895:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346915968:12345-0@lo:503:mount.lustre.0 Request processed in 86us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.356907:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574766.356969:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346915968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574766.357300:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22739:1874407346916096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574766.357337:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.357508:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574766.357567:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916096 00000100:00100000:2.0:1787574766.357571:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916096 00000100:00100000:2.0:1787574766.357605:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574766.357622:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22739:x1874407346916096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.358174:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22739:x1874407346916096:12345-0@lo:502:llog_process_th.0 Request processed in 561us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.358182:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787574766.358285:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22739:1874407346916096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574766.358311:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.358320:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358323:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787574766.358329:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca404bb1800 00000020:00000080:0.0:1787574766.358331:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574766.358341:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.358350:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358351:0:22739:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787574766.358354:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.358357:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358359:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787574766.358362:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca404bb1800 00000020:00000080:0.0:1787574766.358365:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574766.358419:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.358422:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358424:0:22739:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787574766.358426:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.358428:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358429:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787574766.358433:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca404bb1800 00000020:00000080:0.0:1787574766.358435:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787574766.358451:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.358454:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358456:0:22739:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787574766.358458:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574766.358461:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.358462:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1787574766.358465:0:22739:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca404bb1800 00000020:00000080:0.0:1787574766.358467:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787574766.358504:0:22739:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22739:1874407346916224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787574766.358539:0:22739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574766.358559:0:22739:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574766.361741:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916224 00000100:00100000:3.0:1787574766.361756:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916224 00000100:00100000:3.0:1787574766.364368:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574766.364382:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22739:x1874407346916224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787574766.364583:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22739:x1874407346916224:12345-0@lo:502:llog_process_th.0 Request processed in 192us (6031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574766.364592:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787574766.364884:0:22739:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22739:1874407346916224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787574766.364922:0:22739:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574766.364930:0:22739:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574766.364932:0:22739:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1787574766.364937:0:22739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787574766.367824:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787574766.367870:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574766.367892:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.367904:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574766.367966:0:22691:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787574766.367969:0:22691:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca404bb1800 10000000:01000000:1.0:1787574766.367971:0:22691:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca404bb1800 10000000:01000000:1.0:1787574766.367975:0:22691:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574766.367980:0:22691:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca404bb1800 from 1 10000000:01000000:1.0:1787574766.367983:0:22691:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787574766.368018:0:22691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368027:0:22691:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368038:0:22691:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.368062:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574766.368124:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.368164:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.368186:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916352 00000100:00100000:1.0:1787574766.368193:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916352 00000100:00100000:1.0:1787574766.368232:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574766.368267:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22691:x1874407346916352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574766.368278:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574766.368300:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb9929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9922 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368324:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb9929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9922 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368335:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74600/0xd18a1efeeddb9929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9922 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368343:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74600, rc 0) 00000100:00100000:1.0:1787574766.368384:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22691:x1874407346916352:12345-0@lo:101:mount.lustre.0 Request processed in 144us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.368391:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574766.368453:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574766.368467:0:22691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9929 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.368477:0:22691:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9929 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.368534:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574766.368560:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.368574:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.368586:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916480 00000100:00100000:1.0:1787574766.368590:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916480 00000100:00100000:1.0:1787574766.369765:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574766.369786:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22691:x1874407346916480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574766.369947:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22691:x1874407346916480:12345-0@lo:501:mount.lustre.0 Request processed in 167us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574766.370041:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574766.370089:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574766.370141:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.370164:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574766.376097:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916608 00000100:00100000:0.0:1787574766.376120:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916608 00000100:00100000:0.0:1787574766.376177:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574766.376187:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+13:22691:x1874407346916608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574766.376389:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+13:22691:x1874407346916608:12345-0@lo:503:mount.lustre.0 Request processed in 203us (6246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574766.376398:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574766.376755:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346916608:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574766.380134:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574766.380384:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346916736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.380460:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.380501:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50664be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.380582:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916736 00000100:00100000:1.0:1787574766.380589:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916736 00000100:00100000:1.0:1787574766.380641:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574766.380651:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346916736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574766.380782:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346916736:12345-0@lo:502:llog_process_th.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.380790:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574766.380843:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346916736:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787574766.380900:0:22743:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787574766.380915:0:22743:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9ca52eea99b8) 00000020:00000080:1.0:1787574766.380934:0:22743:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787574766.381006:0:22743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca404bb1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574766.381010:0:22743:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca404bb1800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787574766.381012:0:22743:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca404bb1800 4 00010000:00080000:1.0:1787574766.381038:0:22743:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca510a5a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574766.384904:0:22743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787574766.385223:0:22743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787574766.385285:0:22743:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574766.385299:0:22743:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd18a1efeeddb9937 00000100:00080000:1.0:1787574766.385309:0:22743:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574766.385316:0:22743:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ca510a5a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574766.385350:0:22743:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579ce00 x1874407346916864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574766.385389:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346916864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787574766.385450:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574766.386798:0:22743:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787574766.387419:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916864 00000100:00100000:0.0:1787574766.387429:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916864 00000100:00100000:0.0:1787574766.387466:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574766.387474:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346916864:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574766.387538:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346916864:12345-0@lo:38:llog_process_th.0 Request processed in 64us (2087us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787574766.387545:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574766.387991:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574766.388001:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca510a5a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574766.388006:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787574766.388010:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346916864:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574766.395855:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346916992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.395948:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.395986:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.396058:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346916992 00000100:00100000:1.0:1787574766.396065:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346916992 00000100:00100000:1.0:1787574766.396107:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574766.396116:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346916992:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574766.396279:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346916992:12345-0@lo:502:llog_process_th.0 Request processed in 163us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.396287:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787574766.396453:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346916992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.396497:0:22743:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346917120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787574766.396529:0:22743:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.396565:0:22743:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.396759:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917120 00000100:00100000:1.0:1787574766.396765:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917120 00000100:00100000:1.0:1787574766.396791:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787574766.396798:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346917120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787574766.396877:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22743:x1874407346917120:12345-0@lo:502:llog_process_th.0 Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.396884:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574766.397794:0:22743:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4f82b38c-81e1-4088-8af8-2f43485ff140:22743:1874407346917120:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787574766.397830:0:22743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1787574766.397902:0:22691:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787574766.397927:0:22691:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787574766.397947:0:22691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9929 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574766.397959:0:22691:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74000/0xd18a1efeeddb9922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9929 expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787574766.398013:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787574766.398015:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.398016:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.398018:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.398019:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.398020:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.398022:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.398023:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.398025:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.398026:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574766.398030:0:22691:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787574766.398033:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574766.398034:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.398036:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.398037:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.398038:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.398039:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.398040:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.398041:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.398042:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.398043:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787574766.398062:0:22691:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787574766.398077:0:22691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346917248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574766.398125:0:22691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574766.398164:0:22691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca507c30540 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.398827:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917248 00000100:00100000:1.0:1787574766.398834:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917248 00000100:00100000:1.0:1787574766.398874:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574766.398882:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22691:x1874407346917248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787574766.398911:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787574766.398924:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787574766.406294:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787574766.406310:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787574766.406486:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574766.406491:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574766.406514:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.406532:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.406540:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.406875:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22691:x1874407346917248:12345-0@lo:253:mount.lustre.0 Request processed in 7991us (8747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.406895:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787574766.407477:0:22691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:22691:1874407346917248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574766.407493:0:22691:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787574766.407497:0:22691:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574766.407498:0:22691:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787574766.407500:0:22691:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574766.407501:0:22691:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574766.407502:0:22691:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574766.407503:0:22691:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574766.407505:0:22691:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574766.407506:0:22691:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787574766.407508:0:22691:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574766.407509:0:22691:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574766.407523:0:22691:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787574766.407710:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 11 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.407726:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 11 pid: 22707 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574766.407740:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346917376:0@lo:104: 00000100:00100000:3.0:1787574766.407782:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574766.407829:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574766.408857:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917376 00000100:00100000:1.0:1787574766.408867:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917376 00000100:00100000:1.0:1787574766.408924:0:22695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574766.408934:0:22695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346917376:12345-0@lo:104: 00010000:00010000:1.0:1787574766.408948:0:22695:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409018:0:22695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574766.409024:0:22695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346917376:12345-0@lo:104: Request processed in 92us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.409032:0:22695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787574766.409053:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574766.409058:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409066:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574766.409071:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409080:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574766.409088:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574766.409094:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574766.409123:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409142:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574766.409160:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409168:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8600/0xd18a1efeeddb9906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb990d expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409185:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574766.409187:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574766.409189:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574766.409213:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574766.409225:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346917504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574766.409281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574766.409323:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917504 00000100:00100000:1.0:1787574766.409328:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917504 00010000:00010000:1.0:1787574766.409345:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 12 pid: 22707 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574766.409366:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574766.409372:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3637:x1874407346917504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574766.409384:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574766.409389:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 12 pid: 22707 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409400:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 12 pid: 22707 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409418:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409433:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574766.409451:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002959020s 00010000:00010000:1.0:1787574766.409457:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409466:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409473:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409480:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409486:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574766.409490:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409495:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409502:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574766.409510:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574766.409540:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3637:x1874407346917504:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574766.409547:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574766.409607:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346917504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574766.409751:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb990d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9906 expref: 11 pid: 22707 timeout: 805 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574766.409762:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346917376:0@lo:104: 00010000:00010000:3.0:1787574766.409783:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.409791:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.409797:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574766.409802:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb993e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787574766.440812:0:22691:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1787574766.441067:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787574766.441465:0:22752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1787574766.441816:0:22752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1787574766.442742:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1787574766.443510:0:22753:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9ca503582300 x1874407346917632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574766.443524:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00000040:01000000:0.0:1787574766.443972:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787574766.444014:0:22691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787574766.444469:0:22691:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787574766.444476:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787574766.444514:0:22691:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574766.445480:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787574766.446020:0:22691:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787574766.446052:0:22691:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1787574766.448961:0:22752:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787574766.449047:0:22752:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1787574766.449433:0:22751:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1787574766.449438:0:22751:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:00080000:0.0:1787574766.451778:0:22691:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787574766.452436:0:22691:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1787574766.454880:0:22691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1787574766.456524:0:22691:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787574766.456559:0:22691:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7bcc1693988 00100000:10000000:0.0:1787574766.456566:0:22691:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787574766.458034:0:22691:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787574766.458059:0:22691:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787574766.458076:0:22691:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787574766.458093:0:22691:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1787574766.459923:0:22691:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574766.460127:0:22691:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574767.026975:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574767.412455:0:22745:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787574767.412464:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574767.418952:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787574767.418967:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787574767.474407:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 10000000:01000000:2.0:1787574767.538474:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574767.538483:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca404bb1800 from 11 10000000:01000000:2.0:1787574767.538490:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574767.538543:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574767.538555:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574767.538567:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574767.538605:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346917760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574767.538682:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574767.538733:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574767.538801:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917760 00000100:00100000:3.0:1787574767.538809:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917760 00000100:00100000:3.0:1787574767.538868:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574767.538878:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+11:22709:x1874407346917760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574767.538893:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574767.538908:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9945 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574767.538943:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574767.538953:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574767.538963:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa000, rc 0) 00000100:00100000:3.0:1787574767.539013:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22709:x1874407346917760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574767.539020:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787574767.539143:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346917760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574767.539158:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574767.539166:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574767.539216:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346917888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787574767.539271:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574767.539298:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574767.539344:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917888 00000100:00100000:0.0:1787574767.539349:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917888 00000100:00100000:0.0:1787574767.539382:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574767.539390:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22709:x1874407346917888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787574767.539405:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574767.539422:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574767.539425:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1787574767.539513:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:22709:x1874407346917888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574767.539520:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787574767.539586:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346917888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574767.539628:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574767.539636:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574767.539644:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574768.050659:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787574768.435706:0:22745:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787574768.435714:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574768.435846:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1787574768.435901:0:22745:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787574768.436052:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:1.0:1787574768.497326:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574769.076188:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574769.525823:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574770.097499:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574770.549332:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574771.122831:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787574771.209232:0:22996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1787574771.442383:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787574771.442390:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787574771.442394:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574771.442403:0:14981:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:0.0:1787574771.442409:0:14981:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574771.442416:0:14981:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca5109ba800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574771.442440:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d66d80 x1874407346918144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574771.442456:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574771.442459:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574771.442463:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574771.442475:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574771.442478:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787574771.442481:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787574771.442483:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca510a5a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574771.442488:0:14981:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9ca510a5a000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574771.442500:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d64a80 x1874407346918272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574771.442522:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574771.442548:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346918016:0@lo:400:kworker.0 00000100:00100000:0.0:1787574771.442624:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574771.442687:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918016 00000100:00100000:0.0:1787574771.442694:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918016 00000100:00100000:0.0:1787574771.442738:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574771.442747:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3636:x1874407346918016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574771.442788:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3636:x1874407346918016:12345-0@lo:400:kworker.0 Request processed in 42us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574771.442796:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574771.442830:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918144:0@lo:38:kworker.0 00000100:00100000:0.0:1787574771.442852:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574771.442867:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346918272:0@lo:38:kworker.0 00000100:00100000:0.0:1787574771.442890:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574771.442922:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918144 00000100:00100000:0.0:1787574771.442925:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918144 00000100:00100000:0.0:1787574771.442948:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574771.442953:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346918144:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787574771.442973:0:22717:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787574771.443000:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346918144:12345-0@lo:38:kworker.0 Request processed in 46us (147us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787574771.443006:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574771.443027:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918272 00000100:00100000:0.0:1787574771.443030:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918272 00000100:00100000:0.0:1787574771.443046:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574771.443050:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346918272:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787574771.443064:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 710 last 0 00000020:00000080:0.0:1787574771.443098:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd18a1efeeddb9953 00000004:00100000:0.0:1787574771.443113:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574771.443258:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9ca534a39800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574771.443293:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3633:x1874407346918272:12345-0@lo:38:kworker.0 Request processed in 242us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574771.443300:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787574771.443335:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574771.443340:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787574771.443343:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918144:0@lo:38:kworker.0 00010000:00080000:0.0:1787574771.443356:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca502d64a80 x1874407346918272/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574771.443368:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1787574771.443374:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787574771.443378:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574771.443380:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca510a5a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574771.443385:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3633:1874407346918272:0@lo:38:kworker.0 00000100:00100000:0.0:1787574771.443424:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346918016:0@lo:400:kworker.0 00000100:00100000:3.0:1787574771.573849:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574772.145459:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574772.416575:0:23048:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574772.416761:0:23048:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787574772.594505:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574773.175319:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574773.212960:0:23098:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574773.213505:0:23098:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787574773.618788:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:2.0:1787574774.196286:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574774.641367:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574775.217595:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574775.670312:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574776.244566:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574776.561767:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574766/real 1787574766] req@ffff9ca53579d180 x1874407346915200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574776 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574776.561795:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53579d180 x1874407346915200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574776 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574776.561805:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574766/real 1787574766] req@ffff9ca53579d500 x1874407346915072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574776 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574776.561815:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53579d500 x1874407346915072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574776 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787574776.561832:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574776.561840:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574776.561843:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346915200:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787574776.561849:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787574776.561853:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787574776.561856:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346915072:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1787574776.562048:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1787574776.562068:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787574776.562072:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787574776.562075:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574776.562080:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 710 00000100:00080000:3.0:1787574776.562096:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787574776.562103:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca5109ba800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574776.562126:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503581180 x1874407346918528/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574776.562144:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574776.562147:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787574776.562149:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574776.562152:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:3.0:1787574776.562155:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574776.562158:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebea000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574776.562169:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918528:0@lo:38:kworker.0 00000100:00100000:3.0:1787574776.562302:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574776.562924:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918528 00000100:00100000:3.0:1787574776.562932:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918528 00000100:00100000:3.0:1787574776.562973:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574776.562981:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346918528:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1787574776.562999:0:22717:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1787574776.563056:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346918528:12345-0@lo:38:kworker.0 Request processed in 73us (752us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787574776.563064:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574776.563097:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503580380 x1874407346918656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574776.563108:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574776.563111:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574776.563113:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574776.563127:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 705 00000100:00080000:3.0:1787574776.563130:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787574776.563134:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca51ebec800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574776.563147:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503580700 x1874407346918784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574776.563322:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918656:0@lo:8:kworker.0 00000400:00000100:1.0:1787574776.563351:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346918656 offset 0 length 520: 4 00000100:00100000:1.0:1787574776.563374:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918784:0@lo:8:kworker.0 00000400:00000100:1.0:1787574776.563390:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346918784 offset 0 length 520: 4 00000100:00080000:1.0:1787574776.563409:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574776.563414:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787574776.563417:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918528:0@lo:38:kworker.0 00000100:00100000:2.0:1787574776.563690:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346918912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574776.563755:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574776.563791:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346918400:0@lo:400:kworker.0 00000100:00100000:2.0:1787574776.563816:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574776.563912:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918912 00000100:00100000:1.0:1787574776.563917:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918912 00000100:00100000:1.0:1787574776.563959:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574776.563967:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346918912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574776.564018:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346918912:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574776.564024:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787574776.564103:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346918400 00000100:00100000:3.0:1787574776.564107:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346918400 00000100:00100000:3.0:1787574776.564152:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787574776.564159:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3635:x1874407346918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574776.564191:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:3635:x1874407346918400:12345-0@lo:400:kworker.0 Request processed in 33us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574776.564198:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787574776.564693:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca503582a00 x1874407346918912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574776.564707:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346918912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574776.564716:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346918400:0@lo:400:kworker.0 00000100:00100000:3.0:1787574776.690931:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574777.265496:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574777.714985:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:3.0:1787574778.289568:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574778.673964:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574778.737309:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00000020:01000004:1.0:1787574779.291128:0:23443:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787574779.291133:0:23443:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787574779.291135:0:23443:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1787574779.291380:0:23443:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca50309d800 00000020:01000004:1.0:1787574779.291395:0:23443:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:1.0:1787574779.291407:0:23443:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787574779.291420:0:23443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9ca52eeacd28) 00000020:00000080:1.0:1787574779.291437:0:23443:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1787574779.313807:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787574779.337083:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.337866:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787574779.338442:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.338827:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.339312:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.339518:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.339851:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.340105:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.340350:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.340556:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.340865:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1787574779.341131:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.341363:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.341620:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787574779.344099:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.344385:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.344959:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.345520:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.345803:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.346090:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.346371:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.346656:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.346963:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.347267:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.347522:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.347854:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.348111:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.348359:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.348592:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1787574779.348850:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1787574779.349046:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.349497:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.349859:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.350113:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.350358:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.350644:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.350968:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.351278:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.351597:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.351890:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.352175:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.352501:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.352797:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787574779.353040:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.353326:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1787574779.353581:0:23443:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00080000:01000000:2.0:1787574779.354605:0:23443:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787574779.354844:0:23443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1787574779.354855:0:23443:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787574779.354871:0:23443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb9961 00000020:01000004:2.0:1787574779.354877:0:23443:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1787574779.354896:0:23443:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787574779.354900:0:23443:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787574779.354905:0:23443:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1787574779.354927:0:23443:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1787574779.354931:0:23443:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787574779.358909:0:23443:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574779.358950:0:23443:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787574779.358954:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574779.358956:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787574779.358957:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574779.358958:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574779.358959:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574779.358960:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574779.358962:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574779.358963:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574779.358964:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574779.358968:0:23443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787574779.358970:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574779.358971:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787574779.358972:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574779.358973:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574779.358974:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574779.358975:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574779.358976:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574779.358977:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574779.358978:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574779.359069:0:23443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787574779.359091:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574779.359163:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.359283:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5013ed780 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.359366:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919040 00000100:00100000:0.0:1787574779.359374:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919040 00000100:00100000:0.0:1787574779.359427:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574779.359436:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:23443:x1874407346919040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574779.359476:0:22705:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787574779.359486:0:22705:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1787574779.359494:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1787574779.359919:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+12:23443:x1874407346919040:12345-0@lo:253:mount.lustre.0 Request processed in 482us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.359927:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574779.359996:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574779.360080:0:23443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787574779.360089:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574779.360091:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787574779.360092:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574779.360093:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574779.360094:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574779.360096:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574779.360097:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787574779.360098:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574779.360099:0:23443:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574779.360117:0:23443:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca50309d800 from lustre-MDT0001 10000000:01000000:2.0:1787574779.360142:0:23443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787574779.360145:0:23443:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787574779.360152:0:23443:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5350b99b8 local copy 00010000:00010000:2.0:1787574779.360161:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574779.360266:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574779.360296:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.360366:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574779.360399:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919168 00000100:00100000:3.0:1787574779.360404:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919168 00000100:00100000:3.0:1787574779.360480:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787574779.360488:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:23443:x1874407346919168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574779.360563:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+12:23443:x1874407346919168:12345-0@lo:501:mount.lustre.0 Request processed in 76us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574779.360569:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574779.360625:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919168:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787574779.360638:0:23443:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787574779.360654:0:23443:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787574779.360660:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.360668:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574779.360707:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca50309d800 10000000:01000000:2.0:1787574779.360713:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787574779.360717:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9ca5350b99b8 10000000:01000000:2.0:1787574779.360725:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787574779.360729:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9ca5350b99b8 from 1 10000000:01000000:2.0:1787574779.360732:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787574779.360754:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.360763:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.360772:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574779.360785:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574779.360810:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.361027:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.361114:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919296 00000100:00100000:0.0:1787574779.361120:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919296 00000100:00100000:0.0:1787574779.361142:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787574779.361150:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+12:23443:x1874407346919296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574779.361158:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574779.361173:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a9400/0xd18a1efeeddb996f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9968 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361192:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a9400/0xd18a1efeeddb996f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9968 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361202:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a9400/0xd18a1efeeddb996f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9968 expref: 13 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361211:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a9400, rc 0) 00000100:00100000:0.0:1787574779.361276:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+13:23443:x1874407346919296:12345-0@lo:101:mount.lustre.0 Request processed in 126us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.361282:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574779.361438:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574779.361450:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb996f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.361471:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb996f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574779.361487:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787574779.361495:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb996f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.361502:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83e00/0xd18a1efeeddb9968 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb996f expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574779.361509:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9ca50309d800 10000000:01000000:2.0:1787574779.361520:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787574779.361523:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9ca50309d800 from 1 10000000:01000000:2.0:1787574779.361526:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787574779.361540:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.361559:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.361566:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574779.361578:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574779.361601:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.361618:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.361722:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919424 00000100:00100000:0.0:1787574779.361727:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919424 00000100:00100000:0.0:1787574779.361744:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787574779.361750:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+13:23443:x1874407346919424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574779.361757:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574779.361764:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a9800/0xd18a1efeeddb997d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9976 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361783:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a9800/0xd18a1efeeddb997d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9976 expref: 14 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361790:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a9800/0xd18a1efeeddb997d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9976 expref: 14 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.361797:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a9800, rc 0) 00000100:00100000:0.0:1787574779.361828:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+14:23443:x1874407346919424:12345-0@lo:101:mount.lustre.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.361834:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574779.361998:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574779.362020:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb997d expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.362027:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb997d expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574779.362036:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787574779.362049:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb997d expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.362056:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82600/0xd18a1efeeddb9976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb997d expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574779.362061:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787574779.362070:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787574779.362074:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9ca50309d800 10000000:01000000:2.0:1787574779.362077:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787574779.362079:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787574779.362081:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787574779.362095:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.362103:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.362110:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574779.362121:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787574779.362145:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.362168:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574779.362275:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919552 00000100:00100000:3.0:1787574779.362280:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919552 00000100:00100000:3.0:1787574779.362306:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574779.362312:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+14:23443:x1874407346919552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574779.362319:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574779.362327:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb998b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9984 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.362340:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb998b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9984 expref: 15 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.362348:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb600/0xd18a1efeeddb998b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9984 expref: 15 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.362355:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb600, rc 0) 00000100:00100000:3.0:1787574779.362382:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919552:12345-0@lo:101:mount.lustre.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574779.362388:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574779.362563:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574779.362572:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb998b expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.362579:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb998b expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787574779.363773:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787574779.364421:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574779.372368:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787574779.372428:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787574779.372444:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787574779.372534:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787574779.372572:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787574779.372587:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787574779.372600:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787574779.372614:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787574779.372629:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787574779.372644:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787574779.372659:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787574779.372675:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787574779.372688:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787574779.372784:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787574779.372801:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787574779.372812:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787574779.372824:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787574779.372837:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787574779.372849:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787574779.372862:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787574779.372876:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787574779.372890:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787574779.372902:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787574779.372916:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787574779.372927:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787574779.372940:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787574779.372952:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787574779.372964:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787574779.372979:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787574779.372993:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787574779.373081:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787574779.373101:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787574779.373117:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787574779.373132:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787574779.373144:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787574779.373156:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787574779.373167:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787574779.373187:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787574779.373201:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787574779.373216:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787574779.373230:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787574779.373270:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787574779.373287:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787574779.373301:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787574779.373328:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787574779.373334:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787574779.373442:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574779.373601:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.373787:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574779.373836:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919680 00000100:00100000:3.0:1787574779.373844:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919680 00000100:00100000:3.0:1787574779.373924:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574779.373934:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574779.374266:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919680:12345-0@lo:501:mount.lustre.0 Request processed in 332us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574779.374274:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787574779.374358:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574779.374395:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574779.374439:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.374580:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574779.374655:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919808 00000100:00100000:1.0:1787574779.374660:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919808 00000100:00100000:1.0:1787574779.374773:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787574779.374781:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574779.375644:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919808:12345-0@lo:503:mount.lustre.0 Request processed in 861us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.375653:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574779.375790:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787574779.376416:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574779.376569:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.376611:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.376688:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574779.376785:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346919936 00000100:00100000:3.0:1787574779.376791:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346919936 00000100:00100000:3.0:1787574779.376833:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787574779.376841:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574779.377629:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346919936:12345-0@lo:502:mount.lustre.0 Request processed in 785us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574779.377637:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574779.377772:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346919936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574779.377980:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1787574779.378079:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1787574779.378097:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1787574779.378109:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1787574779.378120:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1787574779.378147:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1787574779.378159:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1787574779.378170:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1787574779.378183:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1787574779.378196:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1787574779.378209:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1787574779.378221:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1787574779.378235:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1787574779.378386:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1787574779.378401:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1787574779.378413:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1787574779.378424:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1787574779.378438:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1787574779.378450:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1787574779.378525:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1787574779.378550:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1787574779.378565:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1787574779.378575:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1787574779.378587:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1787574779.378597:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1787574779.378608:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1787574779.378618:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1787574779.378629:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1787574779.378639:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1787574779.378649:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1787574779.378659:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1787574779.378671:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1787574779.378682:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1787574779.378693:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1787574779.378777:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1787574779.378788:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1787574779.378798:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1787574779.378808:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1787574779.378828:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1787574779.378839:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1787574779.378849:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1787574779.378859:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1787574779.378869:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1787574779.378881:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1787574779.378912:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346920064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.378965:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.379117:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574779.379156:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920064 00000100:00100000:1.0:1787574779.379163:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920064 00000100:00100000:1.0:1787574779.379207:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787574779.379215:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346920064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574779.379521:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346920064:12345-0@lo:502:mount.lustre.0 Request processed in 306us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.379548:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574779.379672:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346920064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574779.379797:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1787574779.379807:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1787574779.381260:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574779.381271:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.381274:0:23447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787574779.381281:0:23447:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1787574779.381283:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574779.381297:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9ca5350b8000) 00000020:00000080:0.0:1787574779.381316:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1787574779.381322:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787574779.381402:0:23447:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787574779.381408:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb9999 00000020:00000080:0.0:1787574779.381616:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1787574779.381621:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574779.381623:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.381625:0:23447:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1787574779.381628:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574779.381630:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.381632:0:23447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1787574779.381635:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574779.381642:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9ca4032c99b8) 00000020:00000080:0.0:1787574779.381657:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1787574779.381661:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787574779.381663:0:23447:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1787574779.381666:0:23447:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1787574779.381671:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787574779.381852:0:23447:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca50309d800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1787574779.381863:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9ca4032c8000) 00000020:00000080:0.0:1787574779.381873:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1787574779.381948:0:23447:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787574779.381955:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb99ae 00000020:00000080:0.0:1787574779.382104:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1787574779.382110:0:23447:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787574779.382115:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd18a1efeeddb99b5 00080000:01000000:0.0:1787574779.382120:0:23447:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787574779.382123:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb99bc 00010000:00010000:2.0:1787574779.450605:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787574779.451165:0:23447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787574779.451535:0:23447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787574779.452539:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1787574779.452561:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574779.452567:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574779.452569:0:23447:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1787574779.452572:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574779.452577:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574779.452578:0:23447:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1787574779.452580:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787574779.452585:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:00000080:2.0:1787574779.452611:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574779.452626:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9ca4024c99b8) 00000020:00000080:2.0:1787574779.452644:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1787574779.452649:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787574779.452729:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1787574779.452736:0:23447:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787574779.452742:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb99ca 00010000:00080000:2.0:1787574779.452784:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca536beb800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:2.0:1787574779.456116:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1787574779.457152:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787574779.457167:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1787574779.457203:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787574779.457223:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb99d1 00000100:00080000:0.0:1787574779.457232:0:23447:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574779.457265:0:23447:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9ca536beb800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574779.457300:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d67100 x1874407346920192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574779.457319:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1787574779.457370:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574779.457373:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.457375:0:23447:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1787574779.457378:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787574779.457380:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1787574779.457382:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574779.457383:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574779.457385:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787574779.457393:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.457395:0:23447:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787574779.457398:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787574779.457401:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.457403:0:23447:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1787574779.457406:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787574779.457438:0:23447:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787574779.457450:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787574779.457452:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.457453:0:23447:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:3.0:1787574779.457621:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920192:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574779.457689:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.457757:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920192 00000100:00100000:3.0:1787574779.457765:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920192 00000100:00100000:3.0:1787574779.457797:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574779.457804:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3633:x1874407346920192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787574779.457824:0:22717:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:3.0:1787574779.457852:0:22717:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb99d8 00000004:00100000:3.0:1787574779.457864:0:22717:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1787574779.457869:0:22717:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:0.0:1787574779.458073:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787574779.458075:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1787574779.458077:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574779.458078:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787574779.458079:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787574779.458089:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.458091:0:23447:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787574779.458093:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787574779.458097:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1787574779.458100:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787574779.458101:0:23447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787574779.458104:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787574779.458107:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:0.0:1787574779.458127:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1787574779.458130:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787574779.458143:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9ca4032ccd28) 00000020:00000080:0.0:1787574779.458155:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787574779.458161:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787574779.458217:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1787574779.458225:0:23447:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787574779.458231:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb99e6 00010000:00080000:0.0:1787574779.458290:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca536be8800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574779.458643:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1787574779.459773:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787574779.460096:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1787574779.460308:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787574779.460320:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787574779.460323:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574779.460330:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 715 00000100:00080000:1.0:1787574779.460335:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787574779.460341:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca5109ba800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574779.460376:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579ce00 x1874407346920320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574779.460469:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346920320:0@lo:38:kworker.0 00000100:00100000:3.0:1787574779.460529:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574779.460590:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574779.460595:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574779.460597:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574779.460600:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574779.460640:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346920448:0@lo:400:kworker.0 00000100:00100000:1.0:1787574779.460671:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.460720:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920448 00000100:00100000:1.0:1787574779.460727:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920448 00000100:00100000:1.0:1787574779.460770:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574779.460778:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346920448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574779.460824:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346920448:12345-0@lo:400:kworker.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.460831:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574779.460865:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca53579c380 x1874407346920448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574779.460877:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346920448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574779.463882:0:22716:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1787574779.463896:0:22716:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1787574779.464722:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920320 00000100:00100000:0.0:1787574779.464734:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920320 00000100:00100000:0.0:1787574779.464844:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574779.464852:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346920320:12345-0@lo:38:kworker.0 00000040:00080000:2.0:1787574779.466157:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574779.466837:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787574779.466957:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:2.0:1787574779.468817:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9ca5350cd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574779.468902:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346920192:12345-0@lo:38:llog_process_th.0 Request processed in 11096us (11211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.468913:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1787574779.469431:0:23453:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787574779.469440:0:23453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1787574779.469833:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346920320:12345-0@lo:38:kworker.0 Request processed in 4978us (9301us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787574779.469842:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574779.472552:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574779.472563:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574779.472570:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787574779.472575:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346920320:0@lo:38:kworker.0 00000100:00100000:3.0:1787574779.472589:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574779.472597:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787574779.472606:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787574779.472611:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574779.472613:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536beb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574779.472637:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787574779.472849:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346920576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574779.472908:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.473007:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920576 00000100:00100000:2.0:1787574779.473014:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920576 00000100:00100000:2.0:1787574779.473058:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574779.473066:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346920576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574779.473097:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574779.473198:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1874407346920576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.473205:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574779.473673:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346920576:0@lo:41:osp-pre-0-1.0 00000020:00000080:1.0:1787574779.474561:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574779.474576:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574779.474622:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787574779.474642:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb99ed 00000100:00080000:1.0:1787574779.474650:0:23447:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574779.474655:0:23447:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574779.474683:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579df80 x1874407346920704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574779.476293:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920704:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1787574779.476374:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346920704 offset 0 length 520: 4 00000100:00080000:1.0:1787574779.476642:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787574779.476768:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574779.476774:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.476776:0:23447:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787574779.476779:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787574779.476781:0:23447:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1787574779.476783:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574779.476784:0:23447:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787574779.476785:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787574779.476787:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.476788:0:23447:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787574779.476791:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574779.476795:0:23447:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1787574779.476799:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.476800:0:23447:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787574779.476802:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787574779.476805:0:23447:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.140@tcp to nid 0x20000c0a8ca8c (192.168.202.140@tcp) 00000020:01000000:1.0:1787574779.476825:0:23447:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1787574779.476833:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574779.476846:0:23447:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9ca52eea8000) 00000020:00000080:1.0:1787574779.476865:0:23447:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1787574779.476870:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787574779.476949:0:23447:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1787574779.476956:0:23447:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787574779.476962:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd18a1efeeddb99fb 00010000:00080000:1.0:1787574779.476989:0:23447:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca5350a5800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574779.477281:0:23447:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1787574779.477354:0:23447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787574779.477370:0:23447:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1787574779.479649:0:23447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574779.479940:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1787574779.480446:0:23447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00080000:2.0:1787574779.481406:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.481413:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574779.481416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.481418:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1787574779.481681:0:23455:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787574779.481686:0:23455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787574779.483135:0:23447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1787574779.483149:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787574779.483190:0:23447:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787574779.483316:0:23447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9a02 00000100:00080000:1.0:1787574779.483328:0:23447:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574779.483333:0:23447:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca5350a5800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574779.483366:0:23447:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579ea00 x1874407346920832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574779.483444:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787574779.483531:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346920832 offset 0 length 520: 4 00000100:00080000:1.0:1787574779.483649:0:23447:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787574779.483773:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574779.483778:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.483780:0:23447:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787574779.483783:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574779.483787:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.483788:0:23447:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574779.483790:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574779.483792:0:23447:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574779.483800:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574779.483803:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.483804:0:23447:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574779.483806:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574779.483809:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.483810:0:23447:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574779.483814:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787574779.483842:0:23447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574779.483845:0:23447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574779.483846:0:23447:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574779.483849:0:23447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1787574779.483904:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787574779.483939:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787574779.483955:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb998b expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.483966:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82400/0xd18a1efeeddb9984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb998b expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574779.483975:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca50309d800 from 1 10000000:01000000:1.0:1787574779.483978:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574779.484081:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.484089:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.484100:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574779.484117:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346920960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574779.484155:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.484180:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787574779.484417:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346920960 00000100:00100000:3.0:1787574779.484424:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346920960 00000100:00100000:3.0:1787574779.484478:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787574779.484488:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+15:23443:x1874407346920960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574779.484500:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574779.484512:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a09 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.484533:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.484552:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 16 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.484560:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fa200, rc 0) 00000100:00100000:3.0:1787574779.484594:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+16:23443:x1874407346920960:12345-0@lo:101:mount.lustre.0 Request processed in 108us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574779.484600:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787574779.484822:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346920960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574779.484837:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.484845:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787574779.485106:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.485111:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574779.485119:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.485122:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787574779.485869:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921088:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787574779.485924:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.486018:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.486193:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921088 00000100:00100000:2.0:1787574779.486199:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921088 00000100:00100000:2.0:1787574779.486414:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787574779.486424:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+16:23443:x1874407346921088:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787574779.486442:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787574779.486586:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787574779.486590:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787574779.486853:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+16:23443:x1874407346921088:12345-0@lo:256:mount.lustre.0 Request processed in 430us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.486861:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787574779.486929:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921088:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787574779.487858:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787574779.487934:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.487946:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574779.487955:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca50309d800 from 1 10000000:01000000:1.0:1787574779.487958:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574779.487988:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.487997:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.488082:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574779.488116:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921216:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574779.488163:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.488281:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.490156:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921216 00000100:00100000:2.0:1787574779.490168:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921216 00000100:00100000:2.0:1787574779.490235:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574779.490266:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+16:23443:x1874407346921216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574779.490280:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574779.490294:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a17 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.490319:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.490329:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.490339:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82800, rc 0) 00000100:00100000:2.0:1787574779.490394:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921216:12345-0@lo:101:mount.lustre.0 Request processed in 130us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.490410:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787574779.491947:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921216:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574779.491972:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.491985:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574779.493787:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:1.0:1787574779.494149:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574779.494362:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787574779.494389:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1787574779.494405:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1787574779.494421:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1787574779.494435:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1787574779.494449:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1787574779.494570:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:1.0:1787574779.494585:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:1.0:1787574779.494598:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787574779.494611:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:1.0:1787574779.494624:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:1.0:1787574779.494642:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:1.0:1787574779.494647:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:1.0:1787574779.496387:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921344:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574779.496612:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.496732:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca510167480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.502562:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921344 00000100:00100000:2.0:1787574779.502577:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921344 00000100:00100000:2.0:1787574779.502688:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787574779.502710:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574779.502895:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921344:12345-0@lo:501:mount.lustre.0 Request processed in 187us (6283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.502903:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574779.503011:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574779.503061:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574779.503115:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.509480:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574779.510107:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921472 00000100:00100000:1.0:1787574779.510117:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921472 00000100:00100000:1.0:1787574779.510881:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787574779.510893:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921472:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574779.511077:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921472:12345-0@lo:503:mount.lustre.0 Request processed in 186us (7961us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.511084:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574779.511179:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574779.511692:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574779.511804:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574779.511852:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.513489:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.513587:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921600 00000100:00100000:2.0:1787574779.513596:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921600 00000100:00100000:1.0:1787574779.513656:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787574779.513667:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574779.513827:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921600:12345-0@lo:502:mount.lustre.0 Request processed in 162us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.513835:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574779.513920:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574779.514195:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787574779.514493:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787574779.514511:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787574779.514525:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787574779.514550:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787574779.514568:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787574779.514583:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787574779.514597:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787574779.514613:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787574779.514627:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1787574779.514642:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1787574779.514674:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574779.514729:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.522065:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4b180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.522275:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921728 00000100:00100000:0.0:1787574779.522287:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921728 00000100:00100000:0.0:1787574779.522369:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574779.522379:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921728:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.522954:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921728:12345-0@lo:502:mount.lustre.0 Request processed in 574us (8222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.522963:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787574779.523132:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574779.523235:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787574779.523277:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787574779.524378:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574779.524391:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524393:0:23457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787574779.524399:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca50309d800 00000020:00000080:3.0:1787574779.524402:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574779.524411:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574779.524413:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524415:0:23457:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787574779.524424:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574779.524427:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524428:0:23457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787574779.524431:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca50309d800 00000020:00000080:3.0:1787574779.524433:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574779.524567:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574779.524571:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524573:0:23457:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787574779.524575:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574779.524578:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524579:0:23457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574779.524582:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca50309d800 00000020:00000080:3.0:1787574779.524585:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574779.524601:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574779.524604:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524605:0:23457:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787574779.524607:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787574779.524609:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524610:0:23457:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787574779.524613:0:23457:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca50309d800 00000020:00000080:3.0:1787574779.524615:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787574779.524634:0:23457:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787574779.524636:0:23457:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787574779.524638:0:23457:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787574779.524640:0:23457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1787574779.527817:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787574779.527873:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574779.527893:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.527907:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574779.527981:0:23443:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787574779.527984:0:23443:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca50309d800 10000000:01000000:3.0:1787574779.527987:0:23443:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca50309d800 10000000:01000000:3.0:1787574779.527992:0:23443:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787574779.528285:0:23443:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca50309d800 from 1 10000000:01000000:3.0:1787574779.528289:0:23443:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787574779.528328:0:23443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.528336:0:23443:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.528347:0:23443:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574779.528373:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574779.528445:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.528622:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.533110:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921856 00000100:00100000:2.0:1787574779.533125:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921856 00000100:00100000:2.0:1787574779.533186:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574779.533195:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+17:23443:x1874407346921856:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574779.533220:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574779.533250:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb9a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a25 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.533278:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb9a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a25 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.533288:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82c00/0xd18a1efeeddb9a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a25 expref: 18 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574779.533297:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82c00, rc 0) 00000100:00100000:1.0:1787574779.545862:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574779.545893:0:23443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a2c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.545906:0:23443:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a2c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574779.550382:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1787574779.550820:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574779.550995:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1787574779.551096:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1787574779.551111:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1787574779.551121:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1787574779.551155:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1787574779.551170:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1787574779.551184:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1787574779.551209:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1787574779.551224:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1787574779.551237:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1787574779.551274:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1787574779.551284:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1787574779.551294:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1787574779.551303:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1787574779.551313:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1787574779.551325:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1787574779.551336:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1787574779.551347:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1787574779.551357:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1787574779.551368:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1787574779.551392:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1787574779.551405:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1787574779.551416:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1787574779.551427:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1787574779.551437:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1787574779.551447:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000100:00100000:2.0:1787574779.552590:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346921856:12345-0@lo:101:mount.lustre.0 Request processed in 19389us (24138us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.552602:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:1.0:1787574779.552825:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1787574779.552854:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1787574779.552867:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1787574779.552879:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1787574779.552890:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1787574779.552901:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1787574779.552915:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1787574779.552928:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1787574779.552939:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1787574779.552952:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1787574779.552985:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1787574779.552998:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1787574779.555257:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1787574779.555276:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1787574779.555303:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1787574779.555314:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1787574779.555326:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1787574779.555337:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1787574779.555350:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1787574779.555363:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1787574779.555376:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1787574779.555390:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1787574779.555574:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1787574779.555595:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1787574779.557568:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1787574779.557586:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1787574779.557829:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574779.557894:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.558232:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5101679c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.558632:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346921984 00000100:00100000:2.0:1787574779.558640:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346921984 00000100:00100000:0.0:1787574779.558830:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787574779.558841:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346921984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574779.559119:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346921984:12345-0@lo:501:mount.lustre.0 Request processed in 278us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.559127:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574779.559195:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346921984:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574779.559580:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922112:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574779.559622:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.559688:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca402346f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.559798:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922112 00000100:00100000:0.0:1787574779.559803:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922112 00000100:00100000:0.0:1787574779.559867:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787574779.559877:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574779.560016:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922112:12345-0@lo:503:mount.lustre.0 Request processed in 141us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.560023:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574779.560159:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922112:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787574779.564200:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574779.564785:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922240:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.564870:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.564947:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518f6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.564998:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922240 00000100:00100000:2.0:1787574779.565073:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922240 00000100:00100000:2.0:1787574779.565124:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574779.565132:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574779.565264:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922240:12345-0@lo:502:mount.lustre.0 Request processed in 132us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.565272:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787574779.565579:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922240:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574779.565805:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1787574779.565835:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1787574779.565847:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1787574779.565859:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1787574779.565872:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1787574779.565886:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1787574779.565916:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1787574779.565932:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1787574779.565946:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1787574779.565959:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1787574779.565972:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1787574779.565985:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1787574779.565997:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1787574779.566159:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1787574779.566175:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1787574779.566190:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1787574779.566205:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1787574779.566218:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1787574779.566233:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1787574779.566271:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1787574779.566287:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1787574779.566301:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1787574779.566335:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1787574779.566352:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1787574779.566367:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1787574779.566382:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1787574779.566396:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1787574779.566410:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1787574779.566423:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1787574779.566437:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1787574779.566451:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1787574779.566769:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1787574779.566793:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1787574779.566806:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1787574779.566820:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1787574779.566833:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1787574779.566846:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1787574779.566859:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1787574779.566886:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1787574779.566901:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1787574779.566915:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1787574779.566928:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1787574779.566940:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1787574779.566955:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1787574779.566968:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1787574779.566982:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1787574779.566997:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1787574779.567413:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1787574779.567525:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922368:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.567599:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.567634:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518f6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.568362:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922368 00000100:00100000:2.0:1787574779.568370:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922368 00000100:00100000:2.0:1787574779.568419:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574779.568427:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574779.568633:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922368:12345-0@lo:502:mount.lustre.0 Request processed in 206us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.568641:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787574779.568806:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787574779.568988:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787574779.569363:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787574779.569395:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574779.569434:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.569607:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518f6ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574779.569874:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922496 00000100:00100000:2.0:1787574779.569880:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922496 00000100:00100000:2.0:1787574779.570104:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574779.570114:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574779.570226:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922496:12345-0@lo:502:mount.lustre.0 Request processed in 113us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.570233:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574779.572570:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574779.572676:0:23443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787574779.572750:0:23443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787574779.576900:0:23463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1787574779.576918:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9ca4032cb370) 00000020:00000080:0.0:1787574779.576942:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1787574779.577037:0:23463:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca50309d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787574779.577042:0:23463:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca50309d800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1787574779.577044:0:23463:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca50309d800 3 00010000:00080000:0.0:1787574779.577077:0:23463:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca52f20a800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574779.584313:0:23463:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1787574779.588327:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1787574779.588375:0:23463:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574779.588388:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd18a1efeeddb9a3a 00000100:00080000:0.0:1787574779.588398:0:23463:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574779.588405:0:23463:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9ca52f20a800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574779.588437:0:23463:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d66d80 x1874407346922624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787574779.589565:0:23463:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787574779.589833:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.589840:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574779.589842:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574779.589845:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574779.590145:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346922624:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787574779.590216:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574779.590296:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922624 00000100:00100000:2.0:1787574779.590304:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922624 00000100:00100000:2.0:1787574779.590344:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574779.590352:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346922624:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787574779.590378:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 718 last 0 00000020:00000080:2.0:1787574779.590411:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd18a1efeeddb9a41 00000004:00100000:2.0:1787574779.590426:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787574779.590526:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9ca5138ba000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574779.590598:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3633:x1874407346922624:12345-0@lo:38:llog_process_th.0 Request processed in 245us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574779.590606:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787574779.590632:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca502d66d80 x1874407346922624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574779.590644:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574779.590652:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787574779.590659:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787574779.590663:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787574779.590665:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca52f20a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574779.590679:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3633:1874407346922624:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787574779.590922:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1787574779.591004:0:23443:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787574779.591031:0:23443:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574779.591046:0:23443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a2c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574779.591056:0:23443:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa400/0xd18a1efeeddb9a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a2c expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787574779.591104:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787574779.591106:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787574779.591108:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574779.591109:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574779.591110:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574779.591112:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574779.591113:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574779.591115:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574779.591116:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574779.591181:0:23443:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787574779.591185:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574779.591186:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787574779.591187:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574779.591188:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574779.591189:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574779.591190:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574779.591191:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787574779.591193:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574779.591194:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574779.591211:0:23443:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787574779.591224:0:23443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922752:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574779.591310:0:23443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574779.591332:0:23443:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.591992:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922752 00000100:00100000:0.0:1787574779.592001:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922752 00000100:00100000:0.0:1787574779.592040:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574779.592047:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574779.592072:0:22707:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787574779.592086:0:22707:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1787574779.595422:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1787574779.595503:0:22707:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787574779.595520:0:22707:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1787574779.595618:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787574779.595622:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787574779.595643:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595659:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595668:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595675:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595720:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595733:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 18 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574779.595746:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346922880:0@lo:104: 00000100:00100000:0.0:1787574779.595804:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787574779.595850:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 18 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.595858:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 18 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574779.595866:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346923008:0@lo:104: 00000100:00100000:0.0:1787574779.595882:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.595897:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518f6ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574779.595961:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346922880 00000100:00100000:1.0:1787574779.595969:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346922880 00000100:00100000:1.0:1787574779.596000:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923008 00000100:00100000:1.0:1787574779.596003:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923008 00000100:00100000:1.0:1787574779.596017:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574779.596025:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:22727:x1874407346922880:12345-0@lo:104: 00010000:00010000:1.0:1787574779.596037:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596118:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574779.596130:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:22727:x1874407346922880:12345-0@lo:104: Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.596137:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574779.596154:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574779.596160:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346923008:12345-0@lo:104: 00010000:00010000:1.0:1787574779.596168:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596200:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574779.596206:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346923008:12345-0@lo:104: Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.596211:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787574779.596225:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574779.596231:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596259:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574779.596264:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596272:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574779.596280:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574779.596286:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574779.596310:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596326:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574779.596344:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596351:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a10 expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596362:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574779.596365:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596370:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:1.0:1787574779.596373:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596380:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787574779.596386:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574779.596391:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787574779.596401:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596406:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787574779.596410:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596416:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83000/0xd18a1efeeddb9945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb994c expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596431:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574779.596433:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574779.596435:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574779.596440:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574779.596456:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346923136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574779.596484:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.596509:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574779.596515:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346923264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574779.596535:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574779.596572:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923136 00000100:00100000:1.0:1787574779.596575:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923136 00010000:00010000:1.0:1787574779.596591:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 19 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574779.596608:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923264 00000100:00100000:1.0:1787574779.596610:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923264 00010000:00010000:1.0:1787574779.596617:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 20 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574779.596912:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574779.596919:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+20:3634:x1874407346923136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574779.596929:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574779.596934:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 20 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596944:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 20 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.596970:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574779.597001:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+20:3634:x1874407346923136:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.597008:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574779.597021:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574779.597026:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:3634:x1874407346923264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574779.597033:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574779.597038:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 19 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597046:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 19 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597056:0:22697:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597064:0:22697:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787574779.597076:0:22697:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002959020s 00010000:00010000:1.0:1787574779.597080:0:22697:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597087:0:22697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597092:0:22697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597106:0:22697:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597111:0:22697:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574779.597115:0:22697:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597122:0:22697:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597131:0:22697:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574779.597139:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574779.597167:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:3634:x1874407346923264:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.597173:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574779.597211:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346923264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574779.597220:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346923136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574779.597302:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:23443:x1874407346922752:12345-0@lo:253:mount.lustre.0 Request processed in 5254us (5991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.597310:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787574779.597354:0:23443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:23443:1874407346922752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787574779.597366:0:23443:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1787574779.597370:0:23443:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787574779.597372:0:23443:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1787574779.597378:0:23443:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787574779.597379:0:23443:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787574779.597381:0:23443:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787574779.597382:0:23443:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787574779.597384:0:23443:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787574779.597386:0:23443:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787574779.597387:0:23443:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787574779.597400:0:23443:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1787574779.598184:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa200/0xd18a1efeeddb9a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a09 expref: 17 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574779.598197:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346922880:0@lo:104: 00010000:00010000:0.0:1787574779.598208:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb994c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9945 expref: 16 pid: 22707 timeout: 818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574779.598216:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346923008:0@lo:104: 00010000:00010000:0.0:1787574779.598230:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.598259:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.598266:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574779.598272:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5035a8a00/0xd18a1efeeddb9a48 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1787574779.603330:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787574779.603492:0:23468:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787574779.603496:0:23468:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787574779.611428:0:23469:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787574779.611456:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1787574779.616709:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.616783:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.616825:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923392 00000100:00100000:0.0:1787574779.616831:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923392 00000100:00100000:0.0:1787574779.616877:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574779.616886:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923392:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.616956:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.616978:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574779.617007:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.617030:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1787574779.617056:0:23470:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1787574779.617080:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.617107:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.617130:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923520 00000100:00100000:0.0:1787574779.617134:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923520 00000100:00100000:0.0:1787574779.617157:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574779.617176:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.617294:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 118us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.617300:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574779.617318:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.617330:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.617376:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23470:1874407346923648:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.617404:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.617425:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574779.618982:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923648 00000100:00100000:1.0:1787574779.618993:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923648 00000100:00100000:1.0:1787574779.619037:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574779.619044:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1874407346923648:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1787574779.619121:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1874407346923648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 77us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574779.619129:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1787574779.619601:0:23469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00010000:00080000:0.0:1787574779.620082:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ca502d64380 x1874407346923648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574779.620097:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23470:1874407346923648:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.620170:0:23470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.620224:0:23470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574779.620276:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923776 00000100:00100000:0.0:1787574779.620281:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923776 00000100:00100000:0.0:1787574779.620311:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574779.620318:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1787574779.620377:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23470:x1874407346923776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574779.620383:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574779.620406:0:23470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574779.620418:0:23470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23470:1874407346923776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1787574779.620457:0:23470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787574779.621992:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787574779.622034:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787574779.622475:0:23443:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787574779.622483:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787574779.622519:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574779.623482:0:23443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787574779.623987:0:23443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787574779.624017:0:23443:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787574779.624136:0:23443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787574779.624627:0:23443:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1787574779.627445:0:23469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787574779.627523:0:23469:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1787574779.628591:0:23470:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787574779.628651:0:23470:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787574779.628656:0:23470:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787574779.631095:0:23443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787574779.632673:0:23443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787574779.632709:0:23443:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa7bcc1693988 00100000:10000000:2.0:1787574779.632716:0:23443:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1787574779.633584:0:23443:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787574779.633611:0:23443:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787574779.633627:0:23443:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787574779.633642:0:23443:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1787574779.642282:0:23443:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574779.643176:0:23443:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787574779.765109:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574780.338111:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574780.658734:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787574780.785419:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 10000000:01000000:3.0:1787574781.169798:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787574781.169804:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca50309d800 from 12 10000000:01000000:3.0:1787574781.169819:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574781.169868:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.169879:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.169890:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574781.169915:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346923904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574781.169985:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574781.170029:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574781.170146:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346923904 00000100:00100000:2.0:1787574781.170155:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346923904 00000100:00100000:2.0:1787574781.170212:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574781.170222:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+16:22709:x1874407346923904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574781.170235:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574781.170278:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a4f expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574781.170302:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574781.170312:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574781.170321:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83200, rc 0) 00000100:00100000:2.0:1787574781.170360:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346923904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574781.170367:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787574781.170580:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346923904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574781.170594:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.170603:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574781.170657:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574781.170689:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574781.176407:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574781.183588:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924032 00000100:00100000:2.0:1787574781.183619:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924032 00000100:00100000:2.0:1787574781.183701:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787574781.183713:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346924032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574781.183743:0:22707:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574781.183761:0:22707:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574781.183765:0:22707:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1787574781.184533:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346924032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 812us (13832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574781.184543:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787574781.190939:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787574781.191006:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787574781.191024:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.191034:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574781.191044:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787574781.191047:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca404bb1800 from 12 10000000:01000000:3.0:1787574781.191050:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787574781.191084:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.191093:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.191103:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574781.191122:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574781.191173:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574781.191267:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574781.195940:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924160 00000100:00100000:2.0:1787574781.195956:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924160 00000100:00100000:0.0:1787574781.199007:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574781.199024:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346924160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574781.199046:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574781.199064:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a5d expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574781.199091:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574781.199103:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574781.199112:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8c00, rc 0) 00000100:00100000:0.0:1787574781.199180:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346924160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (8007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574781.199197:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787574781.199415:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574781.199433:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574781.199443:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574781.199513:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574781.199574:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574781.199603:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574781.200104:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924288 00000100:00100000:0.0:1787574781.200111:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924288 00000100:00100000:0.0:1787574781.200153:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574781.200161:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346924288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787574781.200176:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574781.200193:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574781.200196:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787574781.200319:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346924288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 158us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574781.200326:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574781.200538:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346924288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574781.200594:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574781.200602:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574781.200611:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574781.361628:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574781.684058:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574781.812979:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574782.389061:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574782.836138:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00010000:00010000:1.0:1787574783.409730:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574783.857357:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 0 seconds 00000001:02000400:2.0:1787574784.027089:0:23713:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787574784.433594:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574784.754986:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787574784.754993:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1787574784.754997:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574784.755009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9ca5109ba800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574784.755031:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f5880 x1874407346924544/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574784.755048:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574784.755064:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574784.755066:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574784.755069:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574784.755097:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574784.755101:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574784.755104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574784.755107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574784.755285:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346924416:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755363:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574784.755415:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574784.755422:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346924672:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755446:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574784.755481:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346924544:0@lo:38:kworker.0 00000100:00100000:2.0:1787574784.755524:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574784.755554:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346924800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755579:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574784.755598:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574784.755603:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346924928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755626:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574784.755656:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924416 00000100:00100000:2.0:1787574784.755662:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924416 00000100:00100000:2.0:1787574784.755706:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574784.755728:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3636:x1874407346924416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755784:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3636:x1874407346924416:12345-0@lo:400:kworker.0 Request processed in 58us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.755792:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574784.755825:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924672 00000100:00100000:2.0:1787574784.755829:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924672 00000100:00100000:2.0:1787574784.755851:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924928 00000100:00100000:2.0:1787574784.755854:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924928 00000100:00100000:2.0:1787574784.755867:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574784.755873:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346924672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755906:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346924672:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.755912:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574784.755924:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574784.755929:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346924928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.755959:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346924928:12345-0@lo:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.755965:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574784.755982:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924544 00000100:00100000:2.0:1787574784.755985:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924544 00000100:00100000:2.0:1787574784.756002:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346924800 00000100:00100000:2.0:1787574784.756005:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346924800 00000100:00100000:2.0:1787574784.756019:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787574784.756024:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3633:x1874407346924544:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787574784.756047:0:23452:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 723 last 0 00000020:00000080:2.0:1787574784.756095:0:23452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb9a6b 00000004:00100000:2.0:1787574784.756111:0:23452:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1787574784.756117:0:23452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787574784.756199:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574784.756207:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346924800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.756262:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346924800:12345-0@lo:400:kworker.0 Request processed in 34us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.756269:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787574784.756316:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53f4f5500 x1874407346924928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574784.756330:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346924928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.756340:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346924800:0@lo:400:kworker.0 00010000:00080000:2.0:1787574784.756369:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53f4f7b80 x1874407346924672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574784.756377:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346924672:0@lo:400:kworker.0 00000100:00100000:2.0:1787574784.756385:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346924416:0@lo:400:kworker.0 00000100:00100000:1.0:1787574784.758581:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346925056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574784.758668:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574784.764148:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925056 00000100:00100000:1.0:1787574784.764166:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925056 00000100:00100000:1.0:1787574784.764313:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574784.764325:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346925056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574784.764365:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787574784.764471:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346925056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 149us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574784.764479:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574784.764640:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346925056:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1787574784.773035:0:23452:0:(import.c:65:import_set_state_nolock()) ffff9ca53f45d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574784.773628:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346924544:12345-0@lo:38:kworker.0 Request processed in 17600us (18100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574784.773642:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1787574784.777995:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787574784.778010:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1787574784.778017:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787574784.778020:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5109ba800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787574784.778046:0:3633:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ded8c734): req@ffff9ca503582300 x1874407346917632/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574784.778076:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346924544:0@lo:38:kworker.0 00000100:00100000:0.0:1787574784.778340:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574784.778359:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346925184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574784.778434:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574784.778677:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925184 00000100:00100000:0.0:1787574784.778684:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925184 00000100:00100000:0.0:1787574784.778730:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574784.778739:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346925184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574784.778769:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574784.778828:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1874407346925184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574784.778849:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787574784.778888:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346925184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574784.780883:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574784.780922:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535d20c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574784.781054:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346917632 00000100:00100000:2.0:1787574784.781063:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346917632 00000100:00100000:2.0:1787574784.781115:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574784.781125:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346917632:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787574784.781266:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346917632:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.781274:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787574784.781768:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1874407346917632:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787574784.781809:0:22753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787574784.781864:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1874407346925312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787574784.781904:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574784.781927:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1787574784.781956:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925312 00000100:00100000:0.0:1787574784.781963:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925312 00000100:00100000:0.0:1787574784.781994:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574784.782001:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346925312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1787574784.782130:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346925312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 128us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574784.782147:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574784.784639:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1874407346925312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787574784.784773:0:22753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1874407346925440:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787574784.784836:0:22753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574784.784874:0:22753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4010bf000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574784.785173:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925440 00000100:00100000:2.0:1787574784.785181:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925440 00000100:00100000:2.0:1787574784.785266:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574784.785277:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346925440:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1787574784.785362:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1874407346925440:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 86us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574784.785369:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574784.789640:0:22753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22753:1874407346925440:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787574784.789791:0:22753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574784.797005:0:22753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787574784.797099:0:22753:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:3.0:1787574784.797104:0:22753:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:0.0:1787574784.887427:0:23765:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574784.888804:0:23765:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787574785.462280:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787574785.818915:0:23815:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574785.819262:0:23815:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574786.483797:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787574786.694688:0:23863:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff32baf3f0 20000000:00000080:1.0:1787574786.694706:0:23863:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca52a502c00 uarg=0000000000000000 20000000:01000000:1.0:1787574786.694745:0:23863:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787574786.694753:0:23863:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787574786.694758:0:23863:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787574786.695184:0:23864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1787574786.695431:0:23863:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787574786.702097:0:23863:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787574786.702128:0:23863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702149:0:23863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702157:0:23863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702165:0:23863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702208:0:23863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702222:0:23863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574786.702535:0:23863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1874407346925568:0@lo:104: 00000100:00100000:1.0:1787574786.702588:0:23863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787574786.702629:0:23863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 17 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.702635:0:23863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 17 pid: 22707 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574786.702641:0:23863:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1874407346925696:0@lo:104: 00000100:00100000:1.0:1787574786.702653:0:23863:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574786.702671:0:23863:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40344b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574786.702715:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925568 00000100:00100000:2.0:1787574786.702721:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925568 00000100:00100000:2.0:1787574786.702751:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925696 00000100:00100000:2.0:1787574786.702752:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925696 00000100:00100000:2.0:1787574786.702761:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574786.702767:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:23863:x1874407346925568:12345-0@lo:104: 00010000:00010000:2.0:1787574786.702775:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702822:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574786.702826:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:23863:x1874407346925568:12345-0@lo:104: Request processed in 60us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574786.702831:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574786.702842:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574786.702846:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:23863:x1874407346925696:12345-0@lo:104: 00010000:00010000:2.0:1787574786.702857:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702880:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574786.702883:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:23863:x1874407346925696:12345-0@lo:104: Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574786.702887:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787574786.702898:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574786.702903:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702907:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574786.702910:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702916:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574786.702920:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574786.702923:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574786.702957:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702964:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574786.702981:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.702988:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a1e expref: -99 pid: 23443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703002:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574786.703005:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703011:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8000 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574786.703014:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703020:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574786.703025:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574786.703031:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787574786.703044:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703050:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574786.703056:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703062:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9914 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb991b expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703072:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574786.703073:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574786.703074:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574786.703088:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346925824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574786.703111:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574786.703129:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574786.703135:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346925952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574786.703154:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574786.703192:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925824 00000100:00100000:2.0:1787574786.703196:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925824 00010000:00010000:2.0:1787574786.703211:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 18 pid: 22705 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574786.703227:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346925952 00000100:00100000:2.0:1787574786.703230:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346925952 00010000:00010000:2.0:1787574786.703266:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 19 pid: 22707 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574786.703278:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574786.703285:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+19:3634:x1874407346925824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574786.703294:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574786.703299:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 19 pid: 22705 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703369:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 19 pid: 22705 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703384:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574786.703461:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+19:3634:x1874407346925824:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574786.703467:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574786.703491:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574786.703498:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3634:x1874407346925952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574786.703511:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574786.703514:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 18 pid: 22707 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703520:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 18 pid: 22707 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703529:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703534:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703542:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703546:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703550:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703554:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703557:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574786.703560:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703564:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703575:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574786.703581:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574786.703596:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3634:x1874407346925952:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574786.703600:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574786.703624:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346925952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574786.703629:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346925824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574786.703949:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9a1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a17 expref: 17 pid: 22705 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574786.703962:0:23863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1874407346925568:0@lo:104: 00010000:00010000:1.0:1787574786.703972:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb991b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9914 expref: 16 pid: 22707 timeout: 825 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574786.703980:0:23863:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23863:1874407346925696:0@lo:104: 00010000:00010000:1.0:1787574786.703992:0:23863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.704001:0:23863:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.704005:0:23863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574786.704023:0:23863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74800/0xd18a1efeeddb9a72 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574786.705111:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574787.505465:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787574788.273350:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574788.273357:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca50309d800 from 13 10000000:01000000:2.0:1787574788.273363:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574788.273422:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574788.273433:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574788.273445:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574788.273480:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574788.273551:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574788.273599:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71df00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574788.273863:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926080 00000100:00100000:3.0:1787574788.273871:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926080 00000100:00100000:3.0:1787574788.273924:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787574788.273934:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+16:22709:x1874407346926080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574788.273961:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574788.273975:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a79 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574788.274171:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574788.274183:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 17 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574788.274192:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5421fb200, rc 0) 00000100:00100000:3.0:1787574788.274319:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 385us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574788.274326:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787574788.276679:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574788.276708:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574788.276737:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574788.277640:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574788.277706:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574788.277813:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50b71df00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574788.280890:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926208 00000100:00100000:0.0:1787574788.280905:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926208 00000100:00100000:0.0:1787574788.280966:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574788.280977:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.281966:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 986us (4255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574788.281976:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574788.282046:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.282099:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.282163:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574788.282193:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518f6f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574788.282208:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926336 00000100:00100000:0.0:1787574788.282213:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926336 00000100:00100000:0.0:1787574788.282262:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574788.282277:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.283100:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574788.283109:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787574788.283165:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574788.285094:0:23931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574788.285171:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574788.285194:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574788.285205:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285217:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574788.285228:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787574788.285230:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca404bb1800 from 13 10000000:01000000:0.0:1787574788.285234:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787574788.285286:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285305:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285317:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574788.285338:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.285404:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574788.285448:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574788.285478:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926464 00000100:00100000:0.0:1787574788.285484:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926464 00000100:00100000:0.0:1787574788.285520:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787574788.285529:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+17:22709:x1874407346926464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574788.285541:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574788.285552:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9a87 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285573:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285584:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 18 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285593:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8600, rc 0) 00000100:00100000:0.0:1787574788.285627:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346926464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574788.285633:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787574788.285676:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574788.285687:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.285697:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574788.285742:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.285766:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574788.285788:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574788.285869:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926592 00000100:00100000:0.0:1787574788.285873:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926592 00000100:00100000:0.0:1787574788.285896:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574788.285902:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346926592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.286001:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346926592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574788.286007:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574788.286035:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.286060:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.286095:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574788.286107:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574788.286119:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926720 00000100:00100000:0.0:1787574788.286122:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926720 00000100:00100000:0.0:1787574788.286143:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574788.286149:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346926720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574788.286216:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:22709:x1874407346926720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574788.286223:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787574788.286283:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346926720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787574788.286911:0:23932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574788.286957:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574788.286971:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574788.286978:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574788.287000:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574788.531398:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787574788.915650:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787574789.555646:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574789.877630:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574789.877637:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574789.877640:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574789.877643:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574789.877666:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574789.877669:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574789.877671:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574789.877674:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574789.877704:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346926976:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.877773:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.877825:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787574789.877832:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346926848:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.877861:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.877887:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346927360:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.877909:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.877936:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346927104:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.877962:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.877980:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574789.877986:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346927232:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878008:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.878038:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926976 00000100:00100000:3.0:1787574789.878046:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926976 00000100:00100000:3.0:1787574789.878085:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346927232 00000100:00100000:3.0:1787574789.878088:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346927232 00000100:00100000:3.0:1787574789.878117:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574789.878125:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346926976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878177:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346926976:12345-0@lo:400:kworker.0 Request processed in 52us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.878184:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574789.878199:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574789.878205:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346927232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878235:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346927232:12345-0@lo:400:kworker.0 Request processed in 30us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.878262:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574789.878284:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346926848 00000100:00100000:3.0:1787574789.878288:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346926848 00000100:00100000:3.0:1787574789.878312:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574789.878326:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3637:x1874407346926848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878354:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3637:x1874407346926848:12345-0@lo:400:kworker.0 Request processed in 29us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.878360:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574789.878391:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346927360 00000100:00100000:3.0:1787574789.878395:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346927360 00000100:00100000:3.0:1787574789.878416:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346927104 00000100:00100000:3.0:1787574789.878419:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346927104 00000100:00100000:3.0:1787574789.878430:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574789.878436:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346927360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878476:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346927360:12345-0@lo:400:kworker.0 Request processed in 40us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.878482:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787574789.878493:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574789.878500:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346927104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878526:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346927104:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.878532:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574789.878579:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346927232:0@lo:400:kworker.0 00010000:00080000:3.0:1787574789.878593:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca503580a80 x1874407346927104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574789.878603:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346927104:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878630:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346926848:0@lo:400:kworker.0 00010000:00080000:3.0:1787574789.878640:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca503583100 x1874407346927360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574789.878661:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346927360:0@lo:400:kworker.0 00000100:00100000:3.0:1787574789.878674:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346926976:0@lo:400:kworker.0 00000100:00100000:2.0:1787574789.881212:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574779/real 1787574779] req@ffff9ca53579ea00 x1874407346920832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574789 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574789.881317:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346927488:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574789.881513:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53579ea00 x1874407346920832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574789 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574789.881543:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574779/real 1787574779] req@ffff9ca53579df80 x1874407346920704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574789 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574789.881672:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53579df80 x1874407346920704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574789 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574789.881690:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1787574789.881721:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787574789.881740:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346927616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574789.881792:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574789.882076:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574789.882178:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346927616 00000100:00100000:3.0:1787574789.882185:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346927616 00000100:00100000:3.0:1787574789.882225:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346927488 00000100:00100000:3.0:1787574789.882228:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346927488 00000100:00100000:3.0:1787574789.882276:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574789.882286:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346927616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574789.882320:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787574789.882380:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346927616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.882387:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787574789.882402:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574789.882408:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346927488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574789.882423:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574789.882460:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346927488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574789.882465:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574789.882504:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346927616:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574789.882650:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346927488:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1787574789.882739:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574789.882744:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920832:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787574789.882751:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574789.882758:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574789.882762:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346920704:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787574789.882811:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574789.882816:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574789.882818:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574789.882821:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574789.882824:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574789.882826:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787574789.882829:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca536be8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574789.882833:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:0.0:1787574789.882837:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574789.882841:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574789.882867:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d64380 x1874407346927744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574789.882917:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346927744:0@lo:8:kworker.0 00000400:00000100:2.0:1787574789.882966:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346927744 offset 0 length 520: 4 00000100:00080000:0.0:1787574789.883001:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574789.883005:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574789.883007:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574789.883010:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 718 00000100:00080000:0.0:1787574789.883013:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787574789.883023:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca5350a5800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574789.883037:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca502d65880 x1874407346927872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574789.883069:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346927872:0@lo:8:kworker.0 00000400:00000100:2.0:1787574789.883181:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346927872 offset 0 length 520: 4 00010000:00010000:3.0:1787574790.578648:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574790.901148:0:23444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787574791.601486:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574791.927359:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574776/real 1787574776] req@ffff9ca503580380 x1874407346918656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574791 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574791.927395:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca503580380 x1874407346918656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574791 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574791.927405:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574776/real 1787574776] req@ffff9ca503580700 x1874407346918784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574791 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574791.927415:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca503580700 x1874407346918784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574791 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574791.927439:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574791.927456:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574791.927460:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918656:0@lo:8:kworker.0 00000100:00080000:2.0:1787574791.927465:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574791.927470:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574791.927473:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346918784:0@lo:8:kworker.0 00000100:00080000:2.0:1787574791.927608:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574791.927612:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787574791.927615:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574791.927620:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1787574791.927624:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787574791.927642:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebea000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574791.927671:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f4380 x1874407346928256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574791.927685:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574791.927687:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787574791.927689:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787574791.927692:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 715 00000100:00080000:2.0:1787574791.927694:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1787574791.927698:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca51ebec800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:2.0:1787574791.927707:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53f4f7800 x1874407346928384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787574791.927726:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574791.927729:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574791.927731:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574791.927734:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574791.927756:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346928640:0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.927813:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574791.927842:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787574791.927847:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346928000:0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.927872:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574791.927895:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346928768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.927917:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574791.927947:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928640 00000100:00100000:2.0:1787574791.927953:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928640 00000100:00100000:2.0:1787574791.927993:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574791.928008:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346928640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.928058:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346928640:12345-0@lo:400:kworker.0 Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574791.928065:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787574791.928087:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928000 00000100:00100000:2.0:1787574791.928090:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928000 00000100:00100000:2.0:1787574791.928113:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787574791.928119:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3634:x1874407346928000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.928145:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:3634:x1874407346928000:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574791.928151:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787574791.928176:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928768 00000100:00100000:2.0:1787574791.928179:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928768 00000100:00100000:2.0:1787574791.928201:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574791.928207:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346928768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.928234:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346928768:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574791.928261:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574791.928289:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346928256:0@lo:8:kworker.0 00000400:00000100:2.0:1787574791.928309:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346928256 offset 0 length 520: 4 00000100:00100000:2.0:1787574791.928321:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346928384:0@lo:8:kworker.0 00000400:00000100:2.0:1787574791.928334:0:3633:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874407346928384 offset 0 length 520: 4 00000100:00100000:2.0:1787574791.928361:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346928000:0@lo:400:kworker.0 00010000:00080000:2.0:1787574791.928372:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53f4f6d80 x1874407346928768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574791.928393:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346928768:0@lo:400:kworker.0 00000100:00100000:2.0:1787574791.928404:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346928640:0@lo:400:kworker.0 00000040:00080000:1.0:1787574791.931298:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574791.938877:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346928128:0@lo:400:kworker.0 00000100:00100000:0.0:1787574791.938952:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574791.939004:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574791.939012:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346928512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574791.939036:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574791.939076:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928512 00000100:00100000:0.0:1787574791.939084:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928512 00000100:00100000:0.0:1787574791.939129:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574791.939139:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346928512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574791.939191:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346928512:12345-0@lo:400:kworker.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574791.939198:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787574791.939276:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53f4f4700 x1874407346928512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574791.939292:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346928512:0@lo:400:kworker.0 00000100:00100000:0.0:1787574791.941293:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928128 00000100:00100000:0.0:1787574791.941306:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928128 00000100:00100000:0.0:1787574791.941350:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574791.941359:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346928128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574791.941462:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346928128:12345-0@lo:400:kworker.0 Request processed in 104us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574791.941487:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787574791.941529:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346928128:0@lo:400:kworker.0 00000020:01000004:1.0:1787574792.610846:0:24211:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787574792.610852:0:24211:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787574792.610853:0:24211:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787574792.610962:0:24211:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca53509f800 00000020:01000004:1.0:1787574792.610978:0:24211:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787574792.610991:0:24211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787574792.611005:0:24211:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ca52eeab370) 00000020:00000080:1.0:1787574792.611021:0:24211:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1787574792.628471:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787574792.651688:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787574792.654027:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1787574792.654221:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787574792.654627:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1787574792.654802:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787574792.654972:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787574792.655148:0:24211:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1787574792.656232:0:24211:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1787574792.656606:0:24211:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787574792.656619:0:24211:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787574792.656632:0:24211:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb9a9c 00000020:01000004:3.0:1787574792.656638:0:24211:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1787574792.656657:0:24211:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787574792.656661:0:24211:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787574792.656666:0:24211:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787574792.656671:0:24211:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787574792.656680:0:24211:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9ca52f330000) 00000020:00000080:3.0:1787574792.656692:0:24211:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1787574792.659281:0:24211:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787574792.660644:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787574792.660653:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787574792.664035:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787574792.664048:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787574792.664634:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787574792.664641:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787574792.665980:0:24211:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574792.666180:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787574792.666187:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787574792.670542:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787574792.670558:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787574792.686205:0:24211:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574792.686795:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787574792.686802:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787574792.688730:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787574792.688741:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787574792.690827:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787574792.690844:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787574792.693590:0:24211:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574792.693763:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787574792.693768:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787574792.694686:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787574792.694696:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787574792.730969:0:24211:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787574792.731165:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787574792.731172:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787574792.732652:0:24211:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787574792.732662:0:24211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787574792.733908:0:24211:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787574792.733940:0:24211:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787574792.733947:0:24211:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787574792.746067:0:24211:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787574792.746166:0:24211:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.140@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787574792.746171:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787574792.746173:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574792.746174:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574792.746175:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574792.746176:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574792.746177:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574792.746183:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574792.746185:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574792.746186:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574792.746190:0:24211:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787574792.746192:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787574792.746193:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787574792.746194:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787574792.746195:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787574792.746196:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787574792.746197:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787574792.746198:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787574792.746199:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787574792.746200:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787574792.746226:0:24211:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787574792.746281:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346928896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574792.746639:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.746692:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a039c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574792.746754:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346928896 00000100:00100000:3.0:1787574792.746762:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346928896 00000100:00100000:3.0:1787574792.746806:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574792.746825:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:24211:x1874407346928896:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787574792.746856:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787574792.746858:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787574792.746862:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787574792.747111:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+18:24211:x1874407346928896:12345-0@lo:253:mount.lustre.0 Request processed in 286us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574792.747125:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787574792.747280:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346928896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574792.747292:0:24211:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787574792.747294:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574792.747297:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574792.747298:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574792.747300:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574792.747301:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574792.747302:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574792.747303:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574792.747305:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574792.747306:0:24211:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574792.747461:0:24211:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca53509f800 from lustre-OST0000 10000000:01000000:2.0:1787574792.747492:0:24211:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787574792.747495:0:24211:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787574792.747503:0:24211:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5350b99b8 local copy 00010000:00010000:2.0:1787574792.747514:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574792.747602:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929024:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574792.747633:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.747705:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574792.747816:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929024 00000100:00100000:3.0:1787574792.747821:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929024 00000100:00100000:3.0:1787574792.747887:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574792.747895:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:24211:x1874407346929024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574792.747978:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+18:24211:x1874407346929024:12345-0@lo:501:mount.lustre.0 Request processed in 84us (344us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574792.747985:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787574792.748041:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787574792.748052:0:24211:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787574792.748071:0:24211:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787574792.748077:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574792.748095:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574792.748120:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca53509f800 10000000:01000000:0.0:1787574792.748124:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787574792.748129:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787574792.748132:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574792.748160:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787574792.748164:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787574792.748184:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574792.748201:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574792.748209:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574792.748221:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574792.748271:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574792.748823:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509a039c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.748900:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929152 00000100:00100000:2.0:1787574792.748906:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929152 00000100:00100000:2.0:1787574792.748932:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574792.748939:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+18:24211:x1874407346929152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574792.748948:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574792.748959:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83800/0xd18a1efeeddb9ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9aaa expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.748980:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83800/0xd18a1efeeddb9ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9aaa expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.748991:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83800/0xd18a1efeeddb9ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9aaa expref: 19 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.748999:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83800, rc 0) 00000100:00100000:2.0:1787574792.749038:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929152:12345-0@lo:101:mount.lustre.0 Request processed in 98us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.749044:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787574792.749118:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d67480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574792.749131:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9ab1 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574792.749140:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9ab1 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574792.750334:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1787574792.750968:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787574792.753619:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787574792.753679:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787574792.753696:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787574792.753709:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787574792.753722:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787574792.753735:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787574792.753748:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787574792.753762:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787574792.753774:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1787574792.753787:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1787574792.753799:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1787574792.753812:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1787574792.753838:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1787574792.753851:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1787574792.753971:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574792.754043:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.754089:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574792.754293:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929280 00000100:00100000:0.0:1787574792.754301:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929280 00000100:00100000:0.0:1787574792.754373:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787574792.754383:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574792.754536:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929280:12345-0@lo:501:mount.lustre.0 Request processed in 153us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.754544:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574792.754747:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574792.754785:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574792.754822:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.754850:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574792.754913:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929408 00000100:00100000:3.0:1787574792.754918:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929408 00000100:00100000:3.0:1787574792.754941:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574792.754948:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574792.756054:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929408:12345-0@lo:503:mount.lustre.0 Request processed in 1100us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574792.756065:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574792.756165:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787574792.756872:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574792.756971:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.757025:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.757056:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787574792.757132:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929536 00000100:00100000:3.0:1787574792.757138:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929536 00000100:00100000:3.0:1787574792.757181:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787574792.757191:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929536:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574792.757815:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929536:12345-0@lo:502:mount.lustre.0 Request processed in 623us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574792.757825:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787574792.757998:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574792.758535:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1787574792.758570:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1787574792.758584:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1787574792.758596:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1787574792.758606:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1787574792.758618:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1787574792.758631:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1787574792.758643:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1787574792.758653:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1787574792.758666:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1787574792.758686:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1787574792.758700:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1787574792.758734:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.758792:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.758868:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca53bebe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787574792.758930:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929664 00000100:00100000:1.0:1787574792.758936:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929664 00000100:00100000:0.0:1787574792.758990:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787574792.759002:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574792.759142:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929664:12345-0@lo:502:mount.lustre.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.759151:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787574792.761653:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574792.761766:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1787574792.761779:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787574792.762648:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787574792.762656:0:24228:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787574792.762662:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.762664:0:24228:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787574792.762670:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787574792.762684:0:24228:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ca4024c8000) 00000020:00000080:2.0:1787574792.762706:0:24228:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787574792.762711:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787574792.762804:0:24228:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53509f800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787574792.762813:0:24228:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787574792.762821:0:24228:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd18a1efeeddb9abf 00010000:00010000:2.0:1787574792.767217:0:24228:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787574792.767788:0:24228:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787574792.769210:0:24228:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1787574792.771515:0:24228:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787574792.771530:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.771538:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771540:0:24228:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787574792.771543:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787574792.771545:0:24228:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1787574792.771547:0:24228:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574792.771548:0:24228:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787574792.771549:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787574792.771551:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771552:0:24228:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787574792.771555:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.771564:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771566:0:24228:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787574792.771569:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787574792.771571:0:24228:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787574792.771574:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.771576:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771577:0:24228:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787574792.771580:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.771586:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771587:0:24228:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787574792.771591:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787574792.771620:0:24228:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.771623:0:24228:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.771624:0:24228:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787574792.771627:0:24228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1787574792.771796:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787574792.771828:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787574792.771846:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9ab1 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574792.771868:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9600/0xd18a1efeeddb9aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9ab1 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574792.771875:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53509f800 from 1 10000000:01000000:3.0:1787574792.771878:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574792.771914:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574792.771921:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574792.771931:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574792.771954:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574792.772022:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574792.772068:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bfb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.772476:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929792 00000100:00100000:2.0:1787574792.772484:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929792 00000100:00100000:2.0:1787574792.772523:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787574792.772533:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:24211:x1874407346929792:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574792.772547:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574792.772564:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9ac6 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.772588:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.772598:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.772608:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82000, rc 0) 00000100:00100000:2.0:1787574792.772656:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346929792:12345-0@lo:101:mount.lustre.0 Request processed in 124us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.772673:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787574792.772800:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574792.772815:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574792.772823:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574792.774840:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787574792.775139:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574792.775690:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787574792.775717:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787574792.775740:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787574792.775752:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787574792.775765:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787574792.775777:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787574792.775789:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787574792.775802:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787574792.775814:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787574792.775827:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787574792.775852:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787574792.775872:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787574792.775877:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787574792.775958:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574792.776024:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574792.776120:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.782388:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346929920 00000100:00100000:2.0:1787574792.782403:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346929920 00000100:00100000:2.0:1787574792.782471:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787574792.782481:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346929920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574792.782766:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346929920:12345-0@lo:501:mount.lustre.0 Request processed in 285us (6740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.782775:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787574792.783009:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346929920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574792.783061:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930048:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574792.783184:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574792.783223:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.784078:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930048 00000100:00100000:2.0:1787574792.784099:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930048 00000100:00100000:2.0:1787574792.784142:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787574792.784151:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787574792.784293:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930048:12345-0@lo:503:mount.lustre.0 Request processed in 142us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.784303:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787574792.784622:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930048:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787574792.785055:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787574792.785293:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574792.786215:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574792.786277:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574792.787630:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930176 00000100:00100000:0.0:1787574792.787643:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930176 00000100:00100000:0.0:1787574792.788131:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787574792.788143:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930176:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574792.788363:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930176:12345-0@lo:502:mount.lustre.0 Request processed in 222us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.788371:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787574792.788545:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574792.788792:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787574792.788826:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787574792.788843:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787574792.788856:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787574792.788868:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787574792.788880:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787574792.788892:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787574792.788903:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787574792.788914:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787574792.788936:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787574792.788947:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787574792.788980:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574792.789037:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.789942:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.790017:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930304 00000100:00100000:2.0:1787574792.790023:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930304 00000100:00100000:2.0:1787574792.790059:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787574792.790067:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.790182:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930304:12345-0@lo:502:mount.lustre.0 Request processed in 115us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.790189:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787574792.790285:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930304:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574792.790579:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787574792.790591:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1787574792.791729:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.791740:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791743:0:24232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787574792.791749:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53509f800 00000020:00000080:2.0:1787574792.791761:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574792.791768:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.791771:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791772:0:24232:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787574792.791774:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.791776:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791777:0:24232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787574792.791781:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca53509f800 00000020:00000080:2.0:1787574792.791783:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574792.791833:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.791837:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791838:0:24232:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787574792.791840:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.791843:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791844:0:24232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787574792.791847:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53509f800 00000020:00000080:2.0:1787574792.791849:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574792.791864:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.791867:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791868:0:24232:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787574792.791870:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787574792.791872:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791873:0:24232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1787574792.791876:0:24232:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca53509f800 00000020:00000080:2.0:1787574792.791878:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787574792.791897:0:24232:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787574792.791899:0:24232:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787574792.791901:0:24232:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1787574792.791903:0:24232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1787574792.792034:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787574792.792064:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574792.792089:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.792100:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574792.792145:0:24211:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787574792.792148:0:24211:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca53509f800 10000000:01000000:1.0:1787574792.792150:0:24211:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca53509f800 10000000:01000000:1.0:1787574792.792154:0:24211:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787574792.792159:0:24211:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca53509f800 from 1 10000000:01000000:1.0:1787574792.792162:0:24211:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787574792.792193:0:24211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.792200:0:24211:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.792210:0:24211:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574792.792269:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930432:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787574792.792541:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.792574:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.795545:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930432 00000100:00100000:2.0:1787574792.795558:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930432 00000100:00100000:2.0:1787574792.795614:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787574792.795625:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346930432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787574792.795649:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574792.795668:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb9adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9ad4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.795696:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb9adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9ad4 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.795707:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd83c00/0xd18a1efeeddb9adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9ad4 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.795716:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd83c00, rc 0) 00000100:00100000:2.0:1787574792.795796:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930432:12345-0@lo:101:mount.lustre.0 Request processed in 174us (3255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.795803:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787574792.796077:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930432:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574792.796096:0:24211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9adb expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.796105:0:24211:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9adb expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574792.799964:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1787574792.800324:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574792.802310:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1787574792.803614:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1787574792.803638:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1787574792.803652:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1787574792.803679:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1787574792.803694:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1787574792.803707:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1787574792.803719:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1787574792.803732:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1787574792.803745:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1787574792.803758:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1787574792.803770:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1787574792.803782:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1787574792.803794:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1787574792.803806:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1787574792.803820:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1787574792.803832:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1787574792.803855:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1787574792.803869:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1787574792.803884:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1787574792.805848:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1787574792.805885:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1787574792.805898:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1787574792.805910:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1787574792.805923:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1787574792.805935:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1787574792.805950:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1787574792.805961:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1787574792.805975:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1787574792.805988:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1787574792.805999:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1787574792.806009:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1787574792.806022:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1787574792.806034:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1787574792.806048:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1787574792.806062:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1787574792.806092:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1787574792.806108:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1787574792.806123:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1787574792.806135:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1787574792.806148:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1787574792.806159:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1787574792.806172:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1787574792.806184:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1787574792.806197:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1787574792.806210:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1787574792.806223:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1787574792.808531:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1787574792.808770:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1787574792.808791:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1787574792.808819:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1787574792.808825:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1787574792.808938:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574792.809005:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574792.810873:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930560 00000100:00100000:0.0:1787574792.810887:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930560 00000100:00100000:0.0:1787574792.810943:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787574792.810951:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574792.811078:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930560:12345-0@lo:501:mount.lustre.0 Request processed in 128us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.811083:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787574792.814467:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574792.814513:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574792.814581:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574792.814674:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.814715:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574792.816544:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930688 00000100:00100000:0.0:1787574792.816558:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930688 00000100:00100000:0.0:1787574792.816619:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787574792.816630:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574792.816784:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930688:12345-0@lo:503:mount.lustre.0 Request processed in 156us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.816792:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787574792.822221:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930688:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574792.822762:0:24211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574792.822865:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574792.822938:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.822983:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.823218:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930816 00000100:00100000:2.0:1787574792.823224:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930816 00000100:00100000:2.0:1787574792.826618:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787574792.826636:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.826796:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930816:12345-0@lo:502:mount.lustre.0 Request processed in 165us (3858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.826805:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787574792.827021:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574792.827279:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787574792.827313:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787574792.827329:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787574792.827429:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787574792.827446:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787574792.827459:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787574792.827472:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787574792.827485:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787574792.827497:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787574792.827510:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787574792.827523:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787574792.827536:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787574792.827562:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787574792.827576:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787574792.827607:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787574792.827622:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787574792.827635:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787574792.827647:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787574792.827660:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787574792.827673:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787574792.827685:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1787574792.827697:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1787574792.827709:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1787574792.827722:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1787574792.827734:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1787574792.827747:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1787574792.827760:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1787574792.827772:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1787574792.827784:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1787574792.827796:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1787574792.827821:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1787574792.827836:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1787574792.827850:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1787574792.827861:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1787574792.827874:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1787574792.827893:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1787574792.827905:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1787574792.827916:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1787574792.827930:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1787574792.827943:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1787574792.827956:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1787574792.827967:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1787574792.827979:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1787574792.827992:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1787574792.828005:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1787574792.828029:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1787574792.828055:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1787574792.828071:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1787574792.828118:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574792.828176:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.828221:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.832291:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346930944 00000100:00100000:2.0:1787574792.832303:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346930944 00000100:00100000:2.0:1787574792.832370:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787574792.832382:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930944:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.832553:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346930944:12345-0@lo:502:mount.lustre.0 Request processed in 173us (4376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.832570:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787574792.832943:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346930944:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574792.833148:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1787574792.833182:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1787574792.833215:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346931072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574792.833302:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574792.833398:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574792.833462:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931072 00000100:00100000:2.0:1787574792.833468:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931072 00000100:00100000:2.0:1787574792.833497:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787574792.833504:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346931072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574792.833582:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346931072:12345-0@lo:502:mount.lustre.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.833589:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787574792.833655:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346931072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574792.833690:0:24211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1787574792.833697:0:24211:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787574792.834888:0:24237:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787574792.834904:0:24237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9ca5205199b8) 00000020:00000080:1.0:1787574792.834926:0:24237:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1787574792.834997:0:24237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53509f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787574792.835001:0:24237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53509f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787574792.835003:0:24237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53509f800 3 00010000:00080000:1.0:1787574792.835028:0:24237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca401b2f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:1.0:1787574792.836923:0:24237:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1787574792.837196:0:24237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787574792.837236:0:24237:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787574792.837277:0:24237:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd18a1efeeddb9ae9 00000100:00080000:1.0:1787574792.837287:0:24237:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787574792.837292:0:24237:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ca401b2f000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574792.838999:0:24237:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579e680 x1874407346931200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787574792.839042:0:24237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787574792.839435:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574792.839440:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574792.839442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574792.839445:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574792.839479:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574792.839482:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574792.839484:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574792.839487:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574792.839604:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346931584:0@lo:400:kworker.0 00000100:00100000:2.0:1787574792.839676:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.839716:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574792.839723:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346931712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574792.839748:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.839785:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931584 00000100:00100000:2.0:1787574792.839792:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931584 00000100:00100000:2.0:1787574792.839846:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574792.839855:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346931584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574792.839906:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346931584:12345-0@lo:400:kworker.0 Request processed in 52us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.839913:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787574792.839938:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931712 00000100:00100000:2.0:1787574792.839941:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931712 00000100:00100000:2.0:1787574792.839963:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787574792.839970:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346931712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574792.839999:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346931712:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.840015:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787574792.840047:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53579ca80 x1874407346931712/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574792.840061:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346931712:0@lo:400:kworker.0 00000100:00100000:2.0:1787574792.840072:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346931584:0@lo:400:kworker.0 00000100:00100000:0.0:1787574792.840208:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346931200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787574792.840271:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574792.840326:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346931328:0@lo:400:kworker.0 00000100:00100000:0.0:1787574792.840501:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574792.840528:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574792.840535:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346931456:0@lo:400:kworker.0 00000100:00100000:0.0:1787574792.840556:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574792.840593:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931200 00000100:00100000:0.0:1787574792.840599:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931200 00000100:00100000:0.0:1787574792.840612:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931456 00000100:00100000:0.0:1787574792.840614:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931456 00000100:00100000:0.0:1787574792.840629:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574792.840635:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346931456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574792.840670:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346931456:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.840677:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574792.840693:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787574792.840697:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346931200:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574792.840718:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:0.0:1787574792.840762:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd18a1efeeddb9af0 00000004:00100000:0.0:1787574792.840779:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574792.840813:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9ca537200800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574792.840851:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3633:x1874407346931200:12345-0@lo:38:llog_process_th.0 Request processed in 152us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574792.840857:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787574792.840888:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53579e680 x1874407346931200/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574792.840910:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787574792.840917:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1787574792.840925:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787574792.840930:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787574792.840932:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401b2f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787574792.840937:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3633:1874407346931200:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574792.840965:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca53579ea00 x1874407346931456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574792.840973:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346931456:0@lo:400:kworker.0 00000100:00100000:1.0:1787574792.841287:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931328 00000100:00100000:1.0:1787574792.841292:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931328 00000100:00100000:1.0:1787574792.841320:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574792.841327:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346931328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574792.842460:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346931328:12345-0@lo:400:kworker.0 Request processed in 1128us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574792.842470:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574792.843596:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346931328:0@lo:400:kworker.0 00000020:01000004:0.0:1787574792.865834:0:24237:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787574792.865857:0:24237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9ca402223370) 00000020:00000080:0.0:1787574792.865881:0:24237:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1787574792.865968:0:24237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca53509f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787574792.865972:0:24237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca53509f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787574792.865974:0:24237:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca53509f800 3 00010000:00080000:0.0:1787574792.866005:0:24237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca537201800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574792.868562:0:24237:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1787574792.868775:0:24237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1787574792.868823:0:24237:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574792.868851:0:24237:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd18a1efeeddb9afe 00000100:00080000:0.0:1787574792.868861:0:24237:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574792.868866:0:24237:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9ca537201800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574792.868910:0:24237:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5317f7480 x1874407346931840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574792.868995:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346931840:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574792.869064:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574792.869225:0:24237:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787574792.869757:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574792.869762:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574792.869765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574792.869767:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574792.869776:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574792.869779:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574792.869782:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574792.869785:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574792.869883:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931840 00000100:00100000:2.0:1787574792.869891:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931840 00000100:00100000:2.0:1787574792.869964:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574792.869972:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3633:x1874407346931840:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787574792.869996:0:22712:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 732 last 0 00000020:00000080:2.0:1787574792.870029:0:22712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd18a1efeeddb9b05 00000004:00100000:2.0:1787574792.870046:0:22712:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787574792.870076:0:22712:0:(import.c:65:import_set_state_nolock()) ffff9ca4023ff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574792.870144:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3633:x1874407346931840:12345-0@lo:38:llog_process_th.0 Request processed in 171us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.870152:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787574792.870215:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ca5317f7480 x1874407346931840/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574802 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574792.870226:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787574792.870233:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787574792.870256:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787574792.870261:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787574792.870263:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca537201800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787574792.870269:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3633:1874407346931840:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787574792.873969:0:24237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787574792.875526:0:24211:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787574792.875565:0:24211:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574792.875584:0:24211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9adb expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574792.875597:0:24211:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75600/0xd18a1efeeddb9ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9adb expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787574792.875649:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787574792.875651:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574792.875653:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574792.875654:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574792.875655:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574792.875657:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574792.875658:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574792.875664:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574792.875665:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574792.875669:0:24211:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787574792.875672:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574792.875673:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787574792.875674:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574792.875675:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574792.875676:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574792.875677:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574792.875678:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574792.875679:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574792.875680:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574792.875704:0:24211:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787574792.875719:0:24211:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346931968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574792.875775:0:24211:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574792.875807:0:24211:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50353dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574792.875904:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346931968 00000100:00100000:0.0:1787574792.875910:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346931968 00000100:00100000:0.0:1787574792.875951:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787574792.875960:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:24211:x1874407346931968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574792.875986:0:22705:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787574792.875998:0:22705:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787574792.883569:0:22705:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574792.883587:0:22705:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787574792.883600:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787574792.883606:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787574792.883642:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883661:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883688:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883696:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883735:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883748:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 21 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574792.883763:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346932096:0@lo:104: 00000100:00100000:1.0:1787574792.883839:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.883863:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932096 00000100:00100000:2.0:1787574792.883870:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932096 00010000:00010000:1.0:1787574792.883883:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 21 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.883891:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 21 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574792.883898:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346932224:0@lo:104: 00000100:00100000:2.0:1787574792.883913:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574792.883921:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.883922:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346932096:12345-0@lo:104: 00000100:00100000:1.0:1787574792.883931:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787574792.883934:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.883997:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787574792.884004:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346932096:12345-0@lo:104: Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.884012:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574792.884034:0:22696:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787574792.884043:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932224 00000100:00100000:2.0:1787574792.884046:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932224 00000100:00100000:1.0:1787574792.884057:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346932096:0@lo:104: 00000100:00100000:2.0:1787574792.884059:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574792.884064:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca51ea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346932224:12345-0@lo:104: 00010000:00010000:2.0:1787574792.884071:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884117:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787574792.884122:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca51ea40c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346932224:12345-0@lo:104: Request processed in 58us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.884128:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787574792.884168:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574792.884175:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884183:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa600 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574792.884187:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884195:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574792.884202:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574792.884215:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574792.884264:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884271:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574792.884291:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884297:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa600/0xd18a1efeeddb9a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a64 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884319:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574792.884322:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884328:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:2.0:1787574792.884331:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884344:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787574792.884350:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574792.884354:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787574792.884367:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884373:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787574792.884385:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884391:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb400/0xd18a1efeeddb9a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884402:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574792.884404:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574792.884406:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574792.884412:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574792.884458:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346932352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574792.884486:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.884513:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574792.884519:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346932480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574792.884540:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574792.884571:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932352 00000100:00100000:2.0:1787574792.884575:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932352 00010000:00010000:2.0:1787574792.884591:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 22 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574792.884610:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932480 00000100:00100000:2.0:1787574792.884613:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932480 00010000:00010000:2.0:1787574792.884623:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 23 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574792.884636:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574792.884642:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:3636:x1874407346932352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574792.884652:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574792.884657:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 23 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884678:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 23 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884690:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a5d expref: 23 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884699:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574792.884726:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:3636:x1874407346932352:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.884732:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574792.884745:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574792.884751:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3636:x1874407346932480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574792.884758:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574792.884762:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 21 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884770:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 21 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884781:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884787:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787574792.884798:0:22698:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002959020s 00010000:00010000:2.0:1787574792.884802:0:22698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884818:0:22698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884824:0:22698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884830:0:22698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884835:0:22698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574792.884839:0:22698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884845:0:22698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884852:0:22698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574792.884861:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574792.884882:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3636:x1874407346932480:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.884888:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574792.884937:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346932480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574792.884944:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346932352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574792.884998:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+20:24211:x1874407346931968:12345-0@lo:253:mount.lustre.0 Request processed in 9039us (9221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574792.885006:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:1.0:1787574792.885476:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd83200/0xd18a1efeeddb9a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a4f expref: 19 pid: 22705 timeout: 832 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574792.885487:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346932224:0@lo:104: 00010000:00010000:1.0:1787574792.885508:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.885517:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.885522:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574792.885527:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574792.885630:0:24211:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034df800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:24211:1874407346931968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574792.885640:0:24211:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787574792.885643:0:24211:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574792.885645:0:24211:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787574792.885646:0:24211:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574792.885648:0:24211:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574792.885649:0:24211:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574792.885650:0:24211:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574792.885652:0:24211:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574792.885654:0:24211:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574792.885656:0:24211:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787574792.885666:0:24211:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1787574792.887576:0:24211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1787574792.890178:0:24211:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787574792.890186:0:24211:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787574792.890217:0:24211:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787574792.890509:0:24211:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787574792.890532:0:24211:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787574792.890553:0:24211:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1787574792.892499:0:24211:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787574792.892704:0:24211:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787574793.653881:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787574793.677750:0:24291:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574793.677970:0:24291:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787574794.678227:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574794.867829:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574794.867837:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca50309d800 from 13 10000000:01000000:1.0:1787574794.867842:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574794.867886:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574794.867898:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574794.867908:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574794.867931:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574794.867995:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574794.868048:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574794.870425:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932608 00000100:00100000:0.0:1787574794.870443:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932608 00000100:00100000:0.0:1787574794.870769:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787574794.870781:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+19:22709:x1874407346932608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574794.870797:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574794.870815:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9b13 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574794.870839:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574794.870850:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 20 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574794.870861:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8e00, rc 0) 00000100:00100000:0.0:1787574794.870931:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:22709:x1874407346932608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574794.870937:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787574794.871000:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574794.871014:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574794.871027:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574794.871077:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932736:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787574794.871118:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574794.872907:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4034f5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787574794.873524:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932736 00000100:00100000:2.0:1787574794.873533:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932736 00000100:00100000:2.0:1787574794.873579:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787574794.873589:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:22709:x1874407346932736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574794.873626:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574794.873642:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574794.873645:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787574794.873763:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:22709:x1874407346932736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 176us (2643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574794.873771:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787574794.873832:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574794.873900:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574794.873911:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.873920:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574794.873929:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574794.873932:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca404bb1800 from 13 10000000:01000000:2.0:1787574794.873935:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574794.873961:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.873969:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.873976:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574794.873996:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574794.874026:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574794.874060:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50627d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574794.874073:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932864 00000100:00100000:2.0:1787574794.874076:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932864 00000100:00100000:2.0:1787574794.874094:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787574794.874100:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+20:22709:x1874407346932864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574794.874108:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574794.874119:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9b21 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.874148:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.874158:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 21 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.874166:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53bd82800, rc 0) 00000100:00100000:2.0:1787574794.874195:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346932864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574794.874200:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787574794.874227:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574794.874259:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.874267:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574794.874305:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932992:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787574794.874330:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574794.874344:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50627d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574794.874354:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346932992 00000100:00100000:2.0:1787574794.874357:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346932992 00000100:00100000:2.0:1787574794.874374:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574794.874380:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346932992:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787574794.874390:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787574794.874400:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787574794.874417:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1787574794.874476:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346932992:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574794.874482:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787574794.874509:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346932992:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574794.874551:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574794.874556:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574794.874563:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574794.993635:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574794.993712:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574794.994269:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933120 00000100:00100000:1.0:1787574794.994279:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933120 00000100:00100000:1.0:1787574794.994392:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574794.994412:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346933120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574794.994449:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787574794.994514:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346933120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574794.994521:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574794.994561:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346933248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574794.994562:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346933120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574794.994616:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574794.994758:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933248 00000100:00100000:1.0:1787574794.994763:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933248 00000100:00100000:1.0:1787574794.994794:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574794.994801:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346933248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787574794.994817:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787574794.994852:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346933248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574794.994858:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574794.994887:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346933248:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787574795.697546:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574796.723558:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574797.745584:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787574798.082818:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574798.082825:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574798.082828:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574798.082830:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574798.082857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574798.082860:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787574798.082862:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787574798.082864:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574798.082909:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346933504:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.083010:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.083052:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346934016:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.083082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.083106:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787574798.083113:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346933376:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.083140:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.083160:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346933888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.083178:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.083202:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346933760:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.083225:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.083264:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787574798.083270:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346933632:0@lo:400:kworker.0 00000100:00100000:1.0:1787574798.083435:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933504 00000100:00100000:1.0:1787574798.083449:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933504 00000100:00100000:1.0:1787574798.083491:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933760 00000100:00100000:1.0:1787574798.083494:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933760 00000100:00100000:1.0:1787574798.083509:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574798.083516:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346933504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574798.085508:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574798.085527:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346933760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574798.089208:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346933504:12345-0@lo:400:kworker.0 Request processed in 5680us (6186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574798.089223:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787574798.091116:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.091165:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca502d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346934144:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091217:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574798.091277:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934016 00000100:00100000:2.0:1787574798.091297:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934016 00000100:00100000:2.0:1787574798.091352:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933888 00000100:00100000:2.0:1787574798.091356:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933888 00000100:00100000:2.0:1787574798.091370:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933632 00000100:00100000:2.0:1787574798.091381:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933632 00000100:00100000:2.0:1787574798.091395:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934144 00000100:00100000:2.0:1787574798.091398:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934144 00000100:00100000:2.0:1787574798.091414:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574798.091422:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346934016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091473:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346934016:12345-0@lo:400:kworker.0 Request processed in 50us (8389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574798.091491:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787574798.091508:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574798.091514:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091542:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346933888:12345-0@lo:400:kworker.0 Request processed in 29us (8363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574798.091548:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574798.091558:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574798.091563:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346933632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091590:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346933632:12345-0@lo:400:kworker.0 Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574798.091596:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574798.091605:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574798.091612:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346934144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091638:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1874407346934144:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574798.091644:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574798.091666:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346933376 00000100:00100000:2.0:1787574798.091670:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346933376 00000100:00100000:2.0:1787574798.091698:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574798.091705:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3637:x1874407346933376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091735:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3637:x1874407346933376:12345-0@lo:400:kworker.0 Request processed in 31us (8593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574798.091741:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787574798.091797:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346933376:0@lo:400:kworker.0 00010000:00080000:2.0:1787574798.091823:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53f4f7480 x1874407346933888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574798.091834:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346933888:0@lo:400:kworker.0 00000100:00100000:2.0:1787574798.091846:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346933504:0@lo:400:kworker.0 00010000:00080000:2.0:1787574798.091855:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca502d66680 x1874407346934016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574798.091864:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346934016:0@lo:400:kworker.0 00010000:00080000:2.0:1787574798.091898:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53f4f5500 x1874407346933632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574798.091908:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346933632:0@lo:400:kworker.0 00010000:00080000:2.0:1787574798.091918:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca502d64700 x1874407346934144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574798.091927:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3635:1874407346934144:0@lo:400:kworker.0 00000100:00080000:3.0:1787574798.092134:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574798.092139:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574798.093188:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346933760:12345-0@lo:400:kworker.0 Request processed in 7660us (9955us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574798.093199:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787574798.093743:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346933760:0@lo:400:kworker.0 00000040:00080000:1.0:1787574798.132141:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787574798.773430:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787574799.121921:0:24582:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787574799.797802:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1787574800.068785:0:24634:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574800.069134:0:24634:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787574800.120589:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346934272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574800.120666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574800.121202:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934272 00000100:00100000:2.0:1787574800.121212:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934272 00000100:00100000:2.0:1787574800.121297:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787574800.121307:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346934272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574800.121338:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574800.121410:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346934272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574800.121417:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787574800.121578:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346934272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574800.126510:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574800.126533:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346934400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574800.126605:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574800.126653:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934400 00000100:00100000:2.0:1787574800.126660:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934400 00000100:00100000:2.0:1787574800.126706:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574800.126715:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346934400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574800.126747:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574800.126789:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346934400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574800.126796:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574800.126837:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346934400:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574800.817433:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787574801.004443:0:24684:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787574801.004652:0:24684:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787574801.144864:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787574801.845902:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574802.865885:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787574803.185543:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574803.185552:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574803.185555:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574803.185558:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574803.185579:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574803.185591:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787574803.185594:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574803.185597:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574803.185771:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346934528:0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.185879:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574803.185943:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346935040:0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.185988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574803.186022:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574803.186028:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346934912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.186056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574803.186096:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934528 00000100:00100000:2.0:1787574803.186104:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934528 00000100:00100000:2.0:1787574803.186161:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574803.186173:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3637:x1874407346934528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.186233:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3637:x1874407346934528:12345-0@lo:400:kworker.0 Request processed in 62us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574803.186280:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787574803.186325:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935040 00000100:00100000:2.0:1787574803.186340:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935040 00000100:00100000:2.0:1787574803.186371:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574803.186377:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346935040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.186414:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346935040:12345-0@lo:400:kworker.0 Request processed in 37us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574803.186421:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574803.186441:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934912 00000100:00100000:2.0:1787574803.186444:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934912 00000100:00100000:2.0:1787574803.186471:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574803.186478:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346934912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.186510:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346934912:12345-0@lo:400:kworker.0 Request processed in 33us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574803.186516:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574803.186568:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346934912:0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.186579:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346934528:0@lo:400:kworker.0 00010000:00080000:2.0:1787574803.186592:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4034dd180 x1874407346935040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574803.186603:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346935040:0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.186906:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346934656:0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.186945:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574803.186981:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346935168:0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187010:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574803.187032:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787574803.187038:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346934784:0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187055:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574803.187068:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346935296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187083:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574803.187108:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935168 00000100:00100000:3.0:1787574803.187112:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935168 00000100:00100000:3.0:1787574803.187142:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934784 00000100:00100000:3.0:1787574803.187144:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934784 00000100:00100000:3.0:1787574803.187154:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935296 00000100:00100000:3.0:1787574803.187156:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935296 00000100:00100000:3.0:1787574803.187170:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574803.187177:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346935168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187225:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346935168:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574803.187231:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574803.187264:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574803.187269:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187306:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346934784:12345-0@lo:400:kworker.0 Request processed in 37us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574803.187312:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787574803.187323:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787574803.187339:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346935296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574803.187362:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346935296:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574803.187368:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1787574803.187385:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574803.187389:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787574803.187406:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4034ded80 x1874407346934784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574803.187418:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346934784:0@lo:400:kworker.0 00010000:00080000:3.0:1787574803.187429:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4034ddc00 x1874407346935296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574803.187437:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346935296:0@lo:400:kworker.0 00010000:00080000:3.0:1787574803.187447:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4034de300 x1874407346935168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787574803.187455:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346935168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.187866:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346934656 00000100:00100000:2.0:1787574803.187872:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346934656 00000100:00100000:2.0:1787574803.187913:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574803.187920:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346934656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574803.187988:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346934656:12345-0@lo:400:kworker.0 Request processed in 68us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574803.187995:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574803.188029:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346934656:0@lo:400:kworker.0 00010000:00010000:0.0:1787574803.891670:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574804.145502:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574789/real 1787574789] req@ffff9ca502d65880 x1874407346927872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574804 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574804.145551:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca502d65880 x1874407346927872/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574804 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574804.145562:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574789/real 1787574789] req@ffff9ca502d64380 x1874407346927744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574804 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574804.145575:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca502d64380 x1874407346927744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574804 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574804.145602:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574804.145789:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574804.145802:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346927872:0@lo:8:kworker.0 00000100:00080000:2.0:1787574804.145809:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574804.147087:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574804.147093:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787574804.147094:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346935424:0@lo:400:kworker.0 00000100:00080000:1.0:1787574804.147096:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574804.147099:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787574804.147129:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574804.147132:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787574804.147136:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca536be8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574804.147142:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 729 00000100:00080000:1.0:1787574804.147148:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787574804.147162:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9ca536be8800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574804.147186:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579f800 x1874407346935936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574804.147196:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787574804.147198:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787574804.147200:0:14981:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787574804.147220:0:14981:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787574804.147224:0:14981:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 729 00000100:00080000:1.0:1787574804.147226:0:14981:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787574804.147230:0:14981:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca5350a5800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:1.0:1787574804.147269:0:14981:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca53579e300 x1874407346936064/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787574804.147274:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574804.147280:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346935552:0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.147311:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574804.147316:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346935680:0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.147356:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346936192:0@lo:400:kworker.0 00000100:00100000:1.0:1787574804.147361:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574804.147379:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574804.147384:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346936448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.147396:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574804.147401:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346936320:0@lo:400:kworker.0 00000100:00100000:1.0:1787574804.147410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574804.147432:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935424 00000100:00100000:3.0:1787574804.147442:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935424 00000100:00100000:1.0:1787574804.147707:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574804.147715:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346935808:0@lo:400:kworker.0 00000100:00100000:1.0:1787574804.147741:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574804.147779:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935680 00000100:00100000:1.0:1787574804.147783:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935680 00000100:00100000:0.0:1787574804.147829:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574804.148334:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936192 00000100:00100000:0.0:1787574804.148340:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936192 00000100:00100000:0.0:1787574804.148370:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936448 00000100:00100000:0.0:1787574804.148374:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936448 00000100:00100000:0.0:1787574804.148388:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936320 00000100:00100000:0.0:1787574804.148391:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936320 00000100:00100000:0.0:1787574804.148407:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574804.148417:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346936192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574804.148493:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346936192:12345-0@lo:400:kworker.0 Request processed in 77us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574804.148501:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787574804.148522:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574804.148528:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346936448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574804.148572:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346936448:12345-0@lo:400:kworker.0 Request processed in 45us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574804.148579:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787574804.148590:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787574804.148596:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346936320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574804.148622:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346936320:12345-0@lo:400:kworker.0 Request processed in 26us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574804.148627:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1787574804.148680:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579f100 x1874407346936320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574804.148696:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346936320:0@lo:400:kworker.0 00010000:00080000:0.0:1787574804.148708:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579fb80 x1874407346936192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574804.148715:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346936192:0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.148998:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574804.149010:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3636:x1874407346935424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.149062:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3636:x1874407346935424:12345-0@lo:400:kworker.0 Request processed in 57us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574804.149069:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787574804.149117:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935552 00000100:00100000:3.0:1787574804.149122:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935552 00000100:00100000:3.0:1787574804.149156:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935808 00000100:00100000:3.0:1787574804.149160:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935808 00000100:00100000:3.0:1787574804.149176:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574804.149182:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346935552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.149218:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346935552:12345-0@lo:400:kworker.0 Request processed in 36us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574804.149224:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787574804.149237:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787574804.149268:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346935808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.149298:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346935808:12345-0@lo:400:kworker.0 Request processed in 31us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574804.149303:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787574804.149423:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346935552:0@lo:400:kworker.0 00000100:00100000:0.0:1787574804.149434:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346935424:0@lo:400:kworker.0 00000100:00100000:1.0:1787574804.149818:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574804.149829:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346935680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574804.149871:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346935680:12345-0@lo:400:kworker.0 Request processed in 45us (2508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574804.149878:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574804.149940:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346935808:0@lo:400:kworker.0 00010000:00080000:1.0:1787574804.149956:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579d500 x1874407346935680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574804.149966:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346935680:0@lo:400:kworker.0 00010000:00080000:1.0:1787574804.149979:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579ce00 x1874407346936448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574804.150337:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574804.150345:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca502d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346927744:0@lo:8:kworker.0 00000100:00100000:2.0:1787574804.150385:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346935936:0@lo:8:kworker.0 00000100:00080000:0.0:1787574804.150402:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574804.150407:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574804.150410:0:14981:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574804.150413:0:14981:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787574804.150430:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574804.150477:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346936064:0@lo:8:kworker.0 00000100:00100000:3.0:1787574804.150480:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346935936 00000100:00100000:3.0:1787574804.150485:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346935936 00000100:00100000:2.0:1787574804.150501:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574804.150554:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346936448:0@lo:400:kworker.0 00000100:00100000:3.0:1787574804.154665:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936064 00000100:00100000:3.0:1787574804.154685:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936064 00000100:00100000:1.0:1787574804.154688:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574804.154701:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346935936:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787574804.154748:0:24218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 743 last 0 00000020:00000080:1.0:1787574804.154786:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9b2f 00002000:00100000:1.0:1787574804.154807:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9ca401b2e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1787574804.154812:0:24218:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1787574804.154816:0:24218:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787574804.156433:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1787574804.156475:0:24218:0:(import.c:65:import_set_state_nolock()) ffff9ca401b2a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787574804.157358:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346935936:12345-0@lo:8:kworker.0 Request processed in 2651us (6920us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574804.157372:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787574804.157410:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787574804.157417:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346936064:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1787574804.157437:0:24218:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1787574804.160159:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579f800 x1874407346935936/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574804.160178:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574804.160193:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787574804.160204:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574804.160212:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787574804.160216:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca536be8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574804.160437:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574804.160446:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346935936:0@lo:8:kworker.0 00000100:00100000:2.0:1787574804.161093:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346936576:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1787574804.161094:0:23454:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1787574804.161121:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936704:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1787574804.161175:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574804.161175:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1787574804.161270:0:23453:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787574804.161404:0:23453:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 743344163358ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787574804.161412:0:23453:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1787574804.161456:0:24215:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574804.161464:0:24215:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787574804.161597:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936704 00000100:00100000:3.0:1787574804.161606:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936704 00000100:00080000:3.0:1787574804.161672:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574804.161761:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574804.161773:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23454:x1874407346936704:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1787574804.162048:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574804.162075:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936576 00000100:00100000:0.0:1787574804.162079:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936576 00000100:00100000:0.0:1787574804.162116:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787574804.162124:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874407346936576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574804.162146:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574804.162213:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3635:x1874407346936576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574804.162221:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787574804.162291:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f6a00 x1874407346936576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574804.162313:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346936576:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1787574804.167709:0:23444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787574804.172563:0:24814:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1787574804.172576:0:24814:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1787574804.172711:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23454:x1874407346936704:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10933us (11528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574804.172726:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787574804.173220:0:23454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4380 x1874407346936704/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574820 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574804.173284:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936704:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1787574804.173304:0:23454:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1787574804.173376:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936832:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1787574804.173428:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574804.173460:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574804.173679:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936832 00000100:00100000:3.0:1787574804.173688:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936832 00000100:00100000:3.0:1787574804.173747:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574804.173758:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23454:x1874407346936832:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1787574804.173803:0:24215:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1787574804.173857:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23454:x1874407346936832:12345-0@lo:5:osp-pre-0-1.0 Request processed in 100us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574804.173864:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787574804.173985:0:23454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4380 x1874407346936832/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574820 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574804.173997:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936832:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787574804.174008:0:23454:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787574804.174036:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936960:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787574804.174063:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574804.174087:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5066f4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574804.174264:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346936960 00000100:00100000:0.0:1787574804.174269:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346936960 00000100:00100000:0.0:1787574804.174305:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787574804.174331:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23454:x1874407346936960:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1787574804.174362:0:24217:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1787574804.177775:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346936064:12345-0@lo:8:kworker.0 Request processed in 20347us (27262us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787574804.177793:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787574804.179097:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787574804.179112:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787574804.179118:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346936064:0@lo:8:kworker.0 00000001:00080000:1.0:1787574804.210925:0:24212:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1787574804.210948:0:24212:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787574804.211358:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23454:x1874407346936960:12345-0@lo:5:osp-pre-0-1.0 Request processed in 37031us (37287us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787574804.211378:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787574804.211614:0:23454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4040a5180 x1874407346936960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574820 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574804.211628:0:23454:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787574804.211649:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23454:1874407346936960:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1787574804.211670:0:23454:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1787574804.211746:0:23454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23454:1874407346937088:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1787574804.211815:0:23454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574804.211853:0:23454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afa840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574804.211946:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937088 00000100:00100000:2.0:1787574804.211955:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937088 00000100:00100000:2.0:1787574804.212133:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787574804.212145:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23454:x1874407346937088:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1787574804.212212:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23454:x1874407346937088:12345-0@lo:900:osp-pre-0-1.0 Request processed in 70us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574804.212219:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574804.212404:0:23454:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca53579ce00 x1874407346937088/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574820 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574804.212416:0:23454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23454:1874407346937088:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1787574804.913391:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574805.233677:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574805.233711:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574805.233822:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574805.233926:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937216 00000100:00100000:3.0:1787574805.233937:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937216 00000100:00100000:3.0:1787574805.234015:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574805.234026:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346937216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574805.234070:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574805.234127:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346937216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574805.234135:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787574805.234188:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346937216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574805.249216:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574805.249298:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346937344:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574805.249409:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574805.249667:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937344 00000100:00100000:1.0:1787574805.249678:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937344 00000100:00100000:1.0:1787574805.249743:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787574805.249756:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346937344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787574805.249812:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787574805.249883:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346937344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574805.249891:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574805.250847:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346937344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1787574805.937423:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574806.965225:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574807.993101:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787574808.019736:0:25030:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787574808.019739:0:25030:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787574808.019740:0:25030:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1787574808.019811:0:25030:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ca40222a000 00000020:01000004:0.0:1787574808.019823:0:25030:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787574808.019835:0:25030:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1787574808.019846:0:25030:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9ca4022219b8) 00000020:00000080:0.0:1787574808.019857:0:25030:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1787574808.067332:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787574808.068662:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1787574808.068911:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1787574808.069134:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1787574808.069439:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1787574808.069585:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1787574808.069717:0:25030:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1787574808.075485:0:25030:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1787574808.075674:0:25030:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787574808.075687:0:25030:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787574808.075697:0:25030:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb9b3d 00000020:01000004:0.0:1787574808.075703:0:25030:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1787574808.075722:0:25030:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.140@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787574808.075724:0:25030:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.140@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787574808.075729:0:25030:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787574808.075750:0:25030:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1787574808.075754:0:25030:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.140@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787574808.093357:0:25030:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.140@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787574808.093402:0:25030:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.140@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787574808.093407:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787574808.093408:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574808.093410:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574808.093410:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574808.093412:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574808.093413:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574808.093414:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574808.093416:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574808.093417:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574808.093421:0:25030:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787574808.093423:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787574808.093425:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574808.093426:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574808.093427:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574808.093428:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574808.093429:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574808.093430:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574808.093431:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574808.093432:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787574808.093462:0:25030:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787574808.093484:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787574808.093559:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574808.093638:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.097124:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937472 00000100:00100000:0.0:1787574808.097161:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937472 00000100:00100000:1.0:1787574808.097466:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787574808.097478:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:25030:x1874407346937472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787574808.097517:0:22706:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787574808.097527:0:22706:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787574808.097532:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787574808.098082:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:25030:x1874407346937472:12345-0@lo:253:mount.lustre.0 Request processed in 604us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.098091:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787574808.098194:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937472:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787574808.098220:0:25030:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787574808.098224:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787574808.098226:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787574808.098234:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787574808.098235:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787574808.098236:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787574808.098265:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787574808.098267:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787574808.098269:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787574808.098270:0:25030:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787574808.098301:0:25030:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ca40222a000 from lustre-OST0001 10000000:01000000:2.0:1787574808.098333:0:25030:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787574808.098336:0:25030:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787574808.098344:0:25030:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9ca5350b99b8 local copy 00010000:00010000:2.0:1787574808.098353:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574808.098454:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937600:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574808.098494:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574808.098534:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afa180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.098596:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937600 00000100:00100000:3.0:1787574808.098602:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937600 00000100:00100000:3.0:1787574808.098646:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787574808.098654:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:25030:x1874407346937600:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574808.098735:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:25030:x1874407346937600:12345-0@lo:501:mount.lustre.0 Request processed in 81us (240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787574808.098742:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787574808.099153:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937600:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787574808.099168:0:25030:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.140@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787574808.099210:0:25030:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.140@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787574808.099217:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.099227:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83600/0xd18a1efeeddb9857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb985e expref: -99 pid: 22691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574808.099281:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ca40222a000 10000000:01000000:0.0:1787574808.099296:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787574808.099301:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787574808.099303:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574808.099307:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787574808.099310:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787574808.099335:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.099343:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.099351:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574808.099363:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574808.099396:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.099416:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2180 going to sleep for 11 seconds 00000100:00100000:1.0:1787574808.099596:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937728 00000100:00100000:1.0:1787574808.099603:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937728 00000100:00100000:1.0:1787574808.099639:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787574808.099647:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+21:25030:x1874407346937728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574808.099657:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574808.099669:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9b44 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.099690:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b44 expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.099700:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74c00/0xd18a1efeeddb9b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b44 expref: 22 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.099709:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74c00, rc 0) 00000100:00100000:1.0:1787574808.099743:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346937728:12345-0@lo:101:mount.lustre.0 Request processed in 97us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.099750:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787574808.099916:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574808.099953:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b4b expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.099962:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9b4b expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574808.104583:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1787574808.105327:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574808.110163:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787574808.110327:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787574808.110349:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787574808.110364:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787574808.110377:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787574808.110390:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787574808.110405:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787574808.110438:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787574808.110452:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1787574808.110479:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1787574808.110485:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1787574808.110597:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574808.110666:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.110768:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b95d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574808.113084:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937856 00000100:00100000:2.0:1787574808.113099:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937856 00000100:00100000:2.0:1787574808.114454:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787574808.114474:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346937856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787574808.114677:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346937856:12345-0@lo:501:mount.lustre.0 Request processed in 211us (4010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574808.114685:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787574808.114797:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787574808.114847:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787574808.114902:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.120785:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b95d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.121027:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346937984 00000100:00100000:3.0:1787574808.121037:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346937984 00000100:00100000:3.0:1787574808.121092:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787574808.121102:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346937984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574808.121919:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346937984:12345-0@lo:503:mount.lustre.0 Request processed in 815us (7013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.122006:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1787574808.125106:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346937984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787574808.126553:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787574808.126638:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574808.126714:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.126832:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5139f1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.126923:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938112 00000100:00100000:0.0:1787574808.126939:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938112 00000100:00100000:3.0:1787574808.129462:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787574808.129489:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346938112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574808.130229:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346938112:12345-0@lo:502:mount.lustre.0 Request processed in 750us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.130256:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787574808.130744:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574808.131177:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787574808.131227:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787574808.131261:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787574808.131279:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787574808.131307:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787574808.131322:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787574808.131334:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787574808.131346:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787574808.131358:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1787574808.131393:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574808.131458:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.131679:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518b95d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574808.131757:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938240 00000100:00100000:2.0:1787574808.131764:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938240 00000100:00100000:2.0:1787574808.131802:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787574808.131810:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346938240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574808.131923:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346938240:12345-0@lo:502:mount.lustre.0 Request processed in 112us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574808.132059:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787574808.132144:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787574808.132189:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1787574808.132208:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1787574808.133402:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787574808.133412:0:25034:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1787574808.133418:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.133420:0:25034:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787574808.133426:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787574808.133439:0:25034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ca520518000) 00000020:00000080:1.0:1787574808.133464:0:25034:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787574808.133470:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787574808.133552:0:25034:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca40222a000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787574808.133560:0:25034:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787574808.133568:0:25034:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd18a1efeeddb9b59 00010000:00010000:1.0:1787574808.138776:0:25034:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1787574808.139379:0:25034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:1.0:1787574808.143363:0:25034:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1787574808.145094:0:25034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787574808.145107:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.145113:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.145115:0:25034:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787574808.145119:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.145123:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.145124:0:25034:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787574808.145127:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787574808.145129:0:25034:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787574808.145131:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.145134:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.145135:0:25034:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787574808.145143:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.145146:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.145147:0:25034:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787574808.145151:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787574808.145181:0:25034:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.145184:0:25034:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.145185:0:25034:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787574808.145188:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1787574808.145604:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787574808.145642:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787574808.145879:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b4b expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.145893:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8400/0xd18a1efeeddb9b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b4b expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574808.145902:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca40222a000 from 1 10000000:01000000:3.0:1787574808.145904:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574808.145955:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.145963:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.145974:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574808.145997:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787574808.146060:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.146107:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca520249f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574808.146231:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938368 00000100:00100000:1.0:1787574808.146271:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938368 00000100:00100000:1.0:1787574808.146324:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787574808.146334:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:25030:x1874407346938368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787574808.146348:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574808.146362:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9b60 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.146387:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.146398:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.146409:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75a00, rc 0) 00000100:00100000:1.0:1787574808.146450:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938368:12345-0@lo:101:mount.lustre.0 Request processed in 117us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.146456:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787574808.146619:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787574808.146634:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.146760:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787574808.150103:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787574808.151486:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787574808.152646:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787574808.152696:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787574808.152713:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787574808.152728:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787574808.152740:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787574808.152755:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787574808.152768:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787574808.152781:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787574808.152795:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787574808.152808:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787574808.152822:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787574808.152846:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787574808.152851:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787574808.154190:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574808.154295:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.154347:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca520249b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.154567:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938496 00000100:00100000:0.0:1787574808.154575:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938496 00000100:00100000:0.0:1787574808.154629:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787574808.154639:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574808.154776:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938496:12345-0@lo:501:mount.lustre.0 Request processed in 137us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.154784:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787574808.155207:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787574808.155411:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787574808.155460:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.155492:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca520249b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.155551:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938624 00000100:00100000:0.0:1787574808.155557:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938624 00000100:00100000:0.0:1787574808.155591:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787574808.155599:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574808.155842:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938624:12345-0@lo:503:mount.lustre.0 Request processed in 243us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.155850:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787574808.155951:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787574808.156683:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787574808.156771:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574808.156816:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574808.156843:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51399b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.156911:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938752 00000100:00100000:3.0:1787574808.156917:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938752 00000100:00100000:3.0:1787574808.157061:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787574808.157076:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574808.157171:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938752:12345-0@lo:502:mount.lustre.0 Request processed in 95us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.157178:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787574808.157491:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574808.157686:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787574808.157714:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1787574808.157730:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1787574808.157753:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1787574808.157768:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1787574808.157780:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1787574808.157791:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1787574808.157802:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1787574808.157814:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1787574808.157825:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1787574808.157837:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1787574808.157858:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787574808.157896:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.158124:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346938880 00000100:00100000:3.0:1787574808.158129:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346938880 00000100:00100000:3.0:1787574808.158166:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787574808.158172:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574808.158450:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346938880:12345-0@lo:502:mount.lustre.0 Request processed in 277us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.158457:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787574808.158525:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca51399b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787574808.158540:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346938880:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787574808.158593:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1787574808.158601:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787574808.166619:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.166634:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166636:0:25038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787574808.166644:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca40222a000 00000020:00000080:1.0:1787574808.166646:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574808.166680:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.166683:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166684:0:25038:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787574808.166686:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.166688:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166689:0:25038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787574808.166692:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ca40222a000 00000020:00000080:1.0:1787574808.166694:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574808.166752:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.166756:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166758:0:25038:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787574808.166761:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.166763:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166764:0:25038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574808.166768:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca40222a000 00000020:00000080:1.0:1787574808.166770:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574808.166790:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.166794:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166795:0:25038:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787574808.166798:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787574808.166800:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166801:0:25038:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787574808.166805:0:25038:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ca40222a000 00000020:00000080:1.0:1787574808.166807:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787574808.166830:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787574808.166833:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787574808.166834:0:25038:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787574808.166837:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1787574808.171100:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1787574808.171153:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574808.171173:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.171210:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574808.172128:0:25030:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787574808.172133:0:25030:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ca40222a000 10000000:01000000:0.0:1787574808.172137:0:25030:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ca40222a000 10000000:01000000:0.0:1787574808.172141:0:25030:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787574808.172148:0:25030:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ca40222a000 from 1 10000000:01000000:0.0:1787574808.172151:0:25030:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787574808.172188:0:25030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.172211:0:25030:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.172363:0:25030:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574808.172391:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787574808.172457:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.172498:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939008 00000100:00100000:0.0:1787574808.172505:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939008 00000100:00100000:0.0:1787574808.172546:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787574808.172556:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+23:25030:x1874407346939008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574808.172568:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574808.172581:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9b6e expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.172614:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b6e expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.172625:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a8c00/0xd18a1efeeddb9b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b6e expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.172635:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8c00, rc 0) 00000100:00100000:0.0:1787574808.173066:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939008:12345-0@lo:101:mount.lustre.0 Request processed in 509us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.173073:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787574808.173121:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.173142:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787574808.173157:0:25030:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b75 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574808.173166:0:25030:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9b75 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574808.181629:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787574808.181921:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787574808.183933:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787574808.188652:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787574808.188679:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787574808.188697:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787574808.188728:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787574808.188744:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787574808.188756:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787574808.188769:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787574808.188794:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787574808.188806:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787574808.188819:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787574808.188830:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787574808.188844:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787574808.188858:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787574808.188870:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787574808.188882:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787574808.188895:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787574808.188907:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787574808.188918:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787574808.188931:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787574808.190317:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787574808.190354:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787574808.190366:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787574808.190378:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787574808.190389:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787574808.190399:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787574808.190410:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787574808.190420:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787574808.190430:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787574808.190441:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787574808.190452:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787574808.190465:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787574808.190476:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787574808.190489:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787574808.190500:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787574808.190512:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787574808.190539:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787574808.190553:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787574808.190565:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787574808.190578:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787574808.190592:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787574808.190619:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787574808.190631:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787574808.190643:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787574808.190656:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787574808.190668:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787574808.190683:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787574808.190695:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787574808.190872:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787574808.190895:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787574808.190915:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787574808.190920:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787574808.191038:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574808.191105:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.191157:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.192669:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939136 00000100:00100000:0.0:1787574808.192683:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939136 00000100:00100000:0.0:1787574808.192752:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787574808.192762:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574808.192930:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939136:12345-0@lo:501:mount.lustre.0 Request processed in 168us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.192937:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787574808.193015:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787574808.193063:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574808.193108:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.193133:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939264 00000100:00100000:0.0:1787574808.193138:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939264 00000100:00100000:0.0:1787574808.193161:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574808.193167:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787574808.196500:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939264:12345-0@lo:503:mount.lustre.0 Request processed in 3324us (3384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.196512:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787574808.196582:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.196608:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787574808.197067:0:25030:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787574808.199468:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574808.199557:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.199607:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939392 00000100:00100000:0.0:1787574808.199615:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939392 00000100:00100000:0.0:1787574808.200461:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787574808.200474:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574808.200617:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939392:12345-0@lo:502:mount.lustre.0 Request processed in 145us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.200627:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787574808.206449:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.206500:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574808.206835:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787574808.206874:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1787574808.206891:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1787574808.206908:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1787574808.206923:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1787574808.206938:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1787574808.206952:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1787574808.206964:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1787574808.206977:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787574808.206991:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1787574808.207005:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1787574808.207020:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1787574808.207050:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1787574808.207063:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1787574808.207077:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1787574808.207101:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1787574808.207116:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1787574808.207130:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1787574808.207145:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1787574808.207158:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1787574808.207187:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787574808.207203:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787574808.207216:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787574808.207229:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787574808.210519:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787574808.210558:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787574808.210573:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787574808.210588:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787574808.210622:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787574808.210637:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787574808.210649:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787574808.210802:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787574808.210819:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787574808.210833:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787574808.210845:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787574808.210859:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787574808.210871:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787574808.210885:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787574808.210897:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787574808.210909:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787574808.210923:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787574808.210937:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787574808.210951:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787574808.210963:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787574808.210991:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787574808.211007:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787574808.211020:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787574808.211033:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787574808.211103:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574808.211182:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.211985:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939520 00000100:00100000:0.0:1787574808.211994:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939520 00000100:00100000:0.0:1787574808.212047:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787574808.212057:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787574808.212206:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939520:12345-0@lo:502:mount.lustre.0 Request processed in 140us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.212215:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787574808.213652:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518758900 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.213836:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574808.214059:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787574808.214091:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787574808.214127:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787574808.214207:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.214784:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518758900 going to sleep for 11 seconds 00000100:00100000:1.0:1787574808.225027:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939648 00000100:00100000:1.0:1787574808.225043:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939648 00000100:00100000:1.0:1787574808.225103:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787574808.225115:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787574808.225351:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346939648:12345-0@lo:502:mount.lustre.0 Request processed in 237us (11151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.225366:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787574808.225501:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346939648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787574808.225590:0:25030:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787574808.225606:0:25030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787574808.229546:0:25044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787574808.229566:0:25044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ca52f333370) 00000020:00000080:3.0:1787574808.229596:0:25044:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1787574808.229705:0:25044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca40222a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574808.229709:0:25044:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca40222a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787574808.229712:0:25044:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca40222a000 3 00010000:00080000:3.0:1787574808.229740:0:25044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca401a11000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:3.0:1787574808.232590:0:25044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1787574808.238587:0:25044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787574808.238637:0:25044:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787574808.238653:0:25044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd18a1efeeddb9b83 00000100:00080000:3.0:1787574808.238750:0:25044:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787574808.238757:0:25044:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ca401a11000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574808.238791:0:25044:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4034dd500 x1874407346939776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574808.238833:0:25044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787574808.239067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574808.239072:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574808.239074:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574808.239081:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574808.239108:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574808.239110:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787574808.239113:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787574808.239116:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 743 00000100:00080000:0.0:1787574808.239120:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1787574808.239124:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca5350a5800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574808.239136:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5317f5500 x1874407346940416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787574808.239448:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346939776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787574808.239517:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.239559:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346940416:0@lo:8:kworker.0 00000100:00100000:1.0:1787574808.239587:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.239623:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939776 00000100:00100000:1.0:1787574808.239628:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939776 00000100:00100000:3.0:1787574808.239743:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346939904:0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.239774:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.239795:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346940544:0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.239819:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.239837:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787574808.239842:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346940032:0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.239863:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.239873:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346940672:0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.239893:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.239912:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346939904 00000100:00100000:3.0:1787574808.239917:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346939904 00000100:00100000:3.0:1787574808.239951:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787574808.239960:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346939904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.240005:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346939904:12345-0@lo:400:kworker.0 Request processed in 46us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.240012:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574808.240103:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346940160:0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.240133:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.240152:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346940800:0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.240186:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.240372:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940544 00000100:00100000:1.0:1787574808.240376:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940544 00000100:00100000:0.0:1787574808.240593:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574808.240600:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346940288:0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.240630:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574808.240682:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940032 00000100:00100000:0.0:1787574808.240689:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940032 00000100:00100000:2.0:1787574808.240730:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940416 00000100:00100000:2.0:1787574808.240736:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940416 00000100:00100000:2.0:1787574808.240755:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940288 00000100:00100000:2.0:1787574808.240767:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940288 00000100:00100000:2.0:1787574808.240802:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574808.240810:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346940288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574808.240851:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346940288:12345-0@lo:400:kworker.0 Request processed in 42us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574808.240857:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787574808.240870:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574808.240874:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346940416:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787574808.240919:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3633:x1874407346940416:12345-0@lo:8:kworker.0 Request processed in 43us (1331us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787574808.240925:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787574808.241042:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940672 00000100:00100000:3.0:1787574808.241047:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940672 00000100:00100000:1.0:1787574808.241823:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940800 00000100:00100000:1.0:1787574808.241829:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940800 00000100:00100000:0.0:1787574808.241918:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574808.241928:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346940544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.241981:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346940544:12345-0@lo:400:kworker.0 Request processed in 55us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.241987:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574808.242003:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574808.242009:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346940032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.242049:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346940032:12345-0@lo:400:kworker.0 Request processed in 41us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.242055:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787574808.242070:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574808.242074:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3633:x1874407346939776:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574808.242093:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:0.0:1787574808.242125:0:22711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd18a1efeeddb9b8a 00000004:00100000:0.0:1787574808.242139:0:22711:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574808.242169:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9ca537203000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574808.242634:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3633:x1874407346939776:12345-0@lo:38:llog_process_th.0 Request processed in 555us (3114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.242641:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787574808.242730:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940160 00000100:00100000:0.0:1787574808.242735:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940160 00000100:00100000:0.0:1787574808.242803:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574808.242810:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346940160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574808.242842:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346940160:12345-0@lo:400:kworker.0 Request processed in 34us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.242848:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787574808.242910:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787574808.242918:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346940672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574808.242951:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346940672:12345-0@lo:400:kworker.0 Request processed in 36us (3057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.242957:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574808.243064:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787574808.243074:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346940800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574808.243113:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346940800:12345-0@lo:400:kworker.0 Request processed in 42us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.243119:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1787574808.243200:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca4034dd500 x1874407346939776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574808.243212:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574808.243220:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787574808.243227:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787574808.243232:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787574808.243257:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca401a11000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787574808.243264:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3633:1874407346939776:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787574808.243276:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787574808.243299:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787574808.243302:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787574808.243305:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346940416:0@lo:8:kworker.0 00010000:00080000:1.0:1787574808.244421:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f7b80 x1874407346940288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574808.244436:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346940288:0@lo:400:kworker.0 00000100:00100000:1.0:1787574808.244448:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346940160:0@lo:400:kworker.0 00010000:00080000:1.0:1787574808.244458:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4a80 x1874407346940800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574808.244467:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346940800:0@lo:400:kworker.0 00000100:00080000:2.0:1787574808.248577:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574808.248588:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574808.248592:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574808.248644:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4e00 x1874407346940032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574808.248672:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346940032:0@lo:400:kworker.0 00010000:00080000:2.0:1787574808.248689:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4000 x1874407346940672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574808.248697:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346940672:0@lo:400:kworker.0 00000100:00100000:2.0:1787574808.248710:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346939904:0@lo:400:kworker.0 00010000:00080000:2.0:1787574808.248721:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4700 x1874407346940544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574808.248729:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346940544:0@lo:400:kworker.0 00000020:01000004:0.0:1787574808.251515:0:25044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787574808.251535:0:25044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9ca402224d28) 00000020:00000080:0.0:1787574808.251563:0:25044:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1787574808.251692:0:25044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ca40222a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787574808.251697:0:25044:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ca40222a000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787574808.251700:0:25044:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ca40222a000 3 00010000:00080000:0.0:1787574808.251730:0:25044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ca404097000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.140@tcp at head 00010000:00010000:0.0:1787574808.260099:0:25044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1787574808.261522:0:25044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1787574808.261572:0:25044:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787574808.261585:0:25044:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd18a1efeeddb9b98 00000100:00080000:0.0:1787574808.261597:0:25044:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787574808.261603:0:25044:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9ca404097000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:0.0:1787574808.261655:0:25044:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca5317f4380 x1874407346940928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787574808.261786:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346940928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787574808.261863:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787574808.261977:0:25044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787574808.262002:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574808.262006:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787574808.262009:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787574808.262012:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787574808.262423:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346940928 00000100:00100000:0.0:1787574808.262432:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346940928 00000100:00100000:0.0:1787574808.262475:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787574808.262482:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3633:x1874407346940928:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787574808.262511:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 747 last 0 00000020:00000080:0.0:1787574808.262542:0:22713:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd18a1efeeddb9b9f 00000004:00100000:0.0:1787574808.262558:0:22713:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787574808.262591:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9ca404090800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574808.269910:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3633:x1874407346940928:12345-0@lo:38:llog_process_th.0 Request processed in 7415us (8034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574808.269927:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787574808.270070:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ca5317f4380 x1874407346940928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787574818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574808.270083:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574808.270095:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1787574808.270104:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787574808.270108:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1787574808.270112:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca404097000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787574808.270119:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3633:1874407346940928:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1787574808.270577:0:25044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1787574808.270671:0:25030:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787574808.270704:0:25030:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787574808.270716:0:25030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b75 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.270726:0:25030:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5035a8000/0xd18a1efeeddb9b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9b75 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787574808.270766:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787574808.270768:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574808.270769:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574808.270770:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574808.270771:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574808.270772:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574808.270774:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574808.270775:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574808.270777:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574808.270780:0:25030:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787574808.270782:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787574808.270783:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574808.270784:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574808.270785:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574808.270786:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574808.270787:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574808.270788:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574808.270789:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574808.270790:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787574808.270812:0:25030:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787574808.270829:0:25030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346941056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787574808.270894:0:25030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.270923:0:25030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787574808.271095:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941056 00000100:00100000:0.0:1787574808.271102:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941056 00000100:00100000:0.0:1787574808.271153:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787574808.271183:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346941056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787574808.271220:0:22706:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787574808.271261:0:22706:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787574808.276183:0:22706:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787574808.276208:0:22706:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787574808.276563:0:22727:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787574808.276568:0:22727:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787574808.276590:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276623:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276631:0:22727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276638:0:22727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276690:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276704:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574808.276718:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346941184:0@lo:104: 00000100:00100000:3.0:1787574808.276783:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574808.276832:0:22727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 24 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.276840:0:22727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 24 pid: 22707 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574808.276848:0:22727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346941312:0@lo:104: 00000100:00100000:3.0:1787574808.276867:0:22727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574808.276881:0:22727:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509afdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574808.276902:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941184 00000100:00100000:3.0:1787574808.276908:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941184 00000100:00100000:3.0:1787574808.276947:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941312 00000100:00100000:3.0:1787574808.276955:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941312 00000100:00100000:3.0:1787574808.276970:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574808.276978:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:22727:x1874407346941184:12345-0@lo:104: 00010000:00010000:3.0:1787574808.276990:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277037:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787574808.277042:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:22727:x1874407346941184:12345-0@lo:104: Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.277048:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574808.277062:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574808.277066:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346941312:12345-0@lo:104: 00010000:00010000:3.0:1787574808.277072:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277103:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787574808.277108:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:22727:x1874407346941312:12345-0@lo:104: Request processed in 42us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.277113:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574808.277141:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346941184:0@lo:104: 00000100:00100000:3.0:1787574808.277150:0:22727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22727:1874407346941312:0@lo:104: 00010000:00010000:3.0:1787574808.277167:0:22727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277182:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787574808.277187:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277499:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574808.277504:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277513:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574808.277520:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574808.277525:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574808.277561:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277567:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787574808.277583:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277590:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd83200/0xd18a1efeeddb9b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b28 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277602:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574808.277605:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277609:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:3.0:1787574808.277612:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.277627:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787574808.277634:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574808.277639:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787574808.277652:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574808.277941:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:25030:x1874407346941056:12345-0@lo:253:mount.lustre.0 Request processed in 6759us (7045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574808.277952:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:3.0:1787574808.278012:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787574808.278054:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346941568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787574808.278085:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574808.278130:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.278137:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53be75200/0xd18a1efeeddb9b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b1a expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.278152:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574808.278154:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574808.278156:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574808.278191:0:25030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4f82b38c-81e1-4088-8af8-2f43485ff140:25030:1874407346941056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787574808.278214:0:25030:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787574808.278224:0:25030:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787574808.278226:0:25030:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787574808.278227:0:25030:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787574808.278228:0:25030:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787574808.278230:0:25030:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787574808.278231:0:25030:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787574808.278232:0:25030:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787574808.278333:0:25030:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787574808.278334:0:25030:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787574808.278352:0:25030:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787574808.279533:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574808.279544:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574808.279560:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346941440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574808.279606:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574808.279698:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941568 00000100:00100000:1.0:1787574808.279705:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941568 00010000:00010000:1.0:1787574808.279735:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 24 pid: 22707 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574808.279759:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941440 00000100:00100000:1.0:1787574808.279762:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941440 00010000:00010000:1.0:1787574808.279774:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 25 pid: 22706 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574808.279787:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574808.279795:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+25:3634:x1874407346941568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787574808.279820:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574808.279825:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 25 pid: 22707 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.279836:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 25 pid: 22707 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.279852:0:22697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9b13 expref: 25 pid: 22707 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574808.279864:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574808.280477:0:22699:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787574808.280488:0:22699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1787574808.280620:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574808.280629:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3636:x1874407346941440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574808.280639:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574808.280645:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280667:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280681:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82800/0xd18a1efeeddb9b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9b21 expref: 24 pid: 22706 timeout: 847 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280692:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280699:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787574808.280713:0:22699:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004145267s 00010000:00010000:3.0:1787574808.280716:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280722:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280728:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280734:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280745:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574808.280749:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280757:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280771:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280782:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574808.280822:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f82b38c-81e1-4088-8af8-2f43485ff140+23:3636:x1874407346941440:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574808.280830:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787574808.280854:0:22727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280860:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574808.280865:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fa000/0xd18a1efeeddb9ba6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574808.282825:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f82b38c-81e1-4088-8af8-2f43485ff140+22:3634:x1874407346941568:12345-0@lo:103:ldlm_bl.0 Request processed in 3019us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574808.282838:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574808.282909:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346941440:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787574808.285101:0:25030:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:2.0:1787574808.287928:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346941568:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1787574808.288492:0:25030:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787574808.288500:0:25030:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787574808.288538:0:25030:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787574808.288580:0:25030:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.140@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787574808.288596:0:25030:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787574808.288614:0:25030:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787574808.293127:0:25030:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787574808.293516:0:25030:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1787574808.374909:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787574809.013697:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574809.332296:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346941696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574809.332371:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574809.332417:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941696 00000100:00100000:0.0:1787574809.332424:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941696 00000100:00100000:0.0:1787574809.332468:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574809.332477:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346941696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787574809.332507:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574809.332565:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346941696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574809.332572:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787574809.332702:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53579e300 x1874407346941696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574809.332721:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346941696:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1787574809.373730:0:25099:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574809.373990:0:25099:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787574810.034534:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787574810.097360:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787574810.097367:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca50309d800 from 14 10000000:01000000:1.0:1787574810.097372:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787574810.097424:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574810.097435:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574810.097461:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574810.097500:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346941824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574810.097578:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574810.097629:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1787574810.097735:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941824 00000100:00100000:0.0:1787574810.097744:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941824 00000100:00100000:0.0:1787574810.097798:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787574810.097807:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346941824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574810.097819:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574810.097834:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9bb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9bad expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574810.097856:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9bad expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574810.097868:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5035a8e00/0xd18a1efeeddb9bb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9bad expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574810.097891:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5035a8e00, rc 0) 00000100:00100000:0.0:1787574810.097952:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346941824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574810.097959:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787574810.098530:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346941824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574810.098551:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bb4 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574810.098561:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9bb4 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574810.098629:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346941952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787574810.098673:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574810.098748:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787574810.098869:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346941952 00000100:00100000:0.0:1787574810.098875:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346941952 00000100:00100000:0.0:1787574810.098962:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787574810.098970:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346941952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787574810.098987:0:22706:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787574810.099005:0:22706:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787574810.099008:0:22706:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787574810.099096:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346941952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574810.099106:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787574810.099159:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346941952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787574810.099263:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787574810.099280:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bb4 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574810.099288:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be75e00/0xd18a1efeeddb9bad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bb4 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787574810.099299:0:22709:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787574810.099301:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9ca404bb1800 from 14 10000000:01000000:2.0:1787574810.099304:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787574810.099325:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574810.099332:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574810.099341:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574810.099355:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346942080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574810.099380:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574810.099801:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca535071f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574810.100008:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942080 00000100:00100000:1.0:1787574810.100015:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942080 00000100:00100000:1.0:1787574810.100050:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787574810.100059:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346942080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574810.100070:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574810.100086:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb9bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9bbb expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574810.100107:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9bbb expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574810.100116:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca53be74200/0xd18a1efeeddb9bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9bbb expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574810.100126:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74200, rc 0) 00000100:00100000:1.0:1787574810.100350:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346942080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 291us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574810.100356:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787574810.100560:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346942080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574810.100575:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bc2 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574810.100583:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9bc2 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574810.100638:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346942208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787574810.100672:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574810.100746:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787574810.100846:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942208 00000100:00100000:1.0:1787574810.100851:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942208 00000100:00100000:1.0:1787574810.100925:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787574810.100933:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346942208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787574810.100955:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787574810.100970:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787574810.100973:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1787574810.101055:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346942208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574810.101062:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787574810.101123:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346942208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787574810.101173:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787574810.101191:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bc2 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574810.101198:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca52a4f8800/0xd18a1efeeddb9bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9bc2 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574810.354411:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787574810.354438:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346942336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574810.354506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574810.354553:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942336 00000100:00100000:0.0:1787574810.354560:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942336 00000100:00100000:0.0:1787574810.354604:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574810.354613:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346942336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574810.354645:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574810.354697:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346942336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574810.354704:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787574810.354758:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346942336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574810.367657:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574810.367676:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346942464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574810.367743:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574810.367926:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942464 00000100:00100000:2.0:1787574810.367935:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942464 00000100:00100000:2.0:1787574810.367983:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574810.367993:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346942464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574810.368027:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574810.368070:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346942464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574810.368077:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787574810.368125:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346942464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574811.060700:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574811.377681:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574791/real 1787574791] req@ffff9ca53f4f4380 x1874407346928256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574811 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.377712:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53f4f4380 x1874407346928256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574811 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.377722:0:3633:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787574791/real 1787574791] req@ffff9ca53f4f7800 x1874407346928384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574811 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.377734:0:3633:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ca53f4f7800 x1874407346928384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787574811 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574811.377753:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574811.377780:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574811.377785:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346928256:0@lo:8:kworker.0 00000100:00080000:2.0:1787574811.377791:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787574811.377796:0:3633:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787574811.377799:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346928384:0@lo:8:kworker.0 00000100:00080000:3.0:1787574811.378220:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574811.378224:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787574811.378226:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574811.378232:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 731 00000100:00080000:3.0:1787574811.378272:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787574811.378281:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ca51ebea000 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574811.378302:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca4034de680 x1874407346942848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574811.378325:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574811.378328:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574811.378330:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574811.378334:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 731 00000100:00080000:3.0:1787574811.378337:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787574811.378340:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ca51ebec800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574811.378354:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503583800 x1874407346942976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787574811.378388:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787574811.378391:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787574811.378393:0:38:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787574811.378397:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9ca5350a5800 using connection 192.168.202.140@tcp/0@lo 00000100:00100000:3.0:1787574811.378407:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ca503583100 x1874407346943488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787574811.378521:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346942592:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378593:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378629:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346943360:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378674:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346944000:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378700:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378724:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1787574811.378730:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346942720:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378753:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378769:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346943616:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378787:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378803:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346944128:0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.378838:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.378866:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944000 00000100:00100000:0.0:1787574811.378874:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944000 00000100:00100000:0.0:1787574811.378927:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943616 00000100:00100000:0.0:1787574811.378930:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943616 00000100:00100000:0.0:1787574811.378943:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944128 00000100:00100000:0.0:1787574811.378946:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944128 00000100:00100000:0.0:1787574811.378963:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574811.378972:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346944000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.379021:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346944000:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.379028:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787574811.379045:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574811.379060:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346943616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.379091:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346943616:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.379096:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787574811.379108:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574811.379114:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346944128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.379138:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346944128:12345-0@lo:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.379144:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787574811.379162:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942720 00000100:00100000:0.0:1787574811.379166:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942720 00000100:00100000:0.0:1787574811.379186:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574811.379193:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346942720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574811.379221:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346942720:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.379227:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787574811.379309:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346942720:0@lo:400:kworker.0 00010000:00080000:0.0:1787574811.379319:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503582300 x1874407346943616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574811.379328:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346943616:0@lo:400:kworker.0 00010000:00080000:0.0:1787574811.379336:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74ed80 x1874407346944128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574811.379343:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346944128:0@lo:400:kworker.0 00010000:00080000:0.0:1787574811.379351:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74f100 x1874407346944000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574811.379367:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346944000:0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.382469:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346942848:0@lo:8:kworker.0 00000100:00100000:2.0:1787574811.382581:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.382639:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346942976:0@lo:8:kworker.0 00000100:00100000:2.0:1787574811.382663:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.382696:0:3633:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346943488:0@lo:8:kworker.0 00000100:00100000:2.0:1787574811.382718:0:3633:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.383067:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346943104:0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.383097:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.383118:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346943744:0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.383139:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.383158:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787574811.383165:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346943232:0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.383189:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.383208:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346943872:0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.383228:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.383374:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942592 00000100:00100000:2.0:1787574811.383382:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942592 00000100:00100000:2.0:1787574811.383433:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574811.383443:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346942592:12345-0@lo:400:kworker.0 00000040:00080000:3.0:1787574811.384102:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574811.384417:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943360 00000100:00100000:0.0:1787574811.384424:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943360 00000100:00100000:0.0:1787574811.384456:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942848 00000100:00100000:0.0:1787574811.384460:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942848 00000100:00100000:0.0:1787574811.384469:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346942976 00000100:00100000:0.0:1787574811.384472:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346942976 00000100:00100000:0.0:1787574811.384480:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943488 00000100:00100000:0.0:1787574811.384483:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943488 00000100:00100000:0.0:1787574811.384495:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574811.384503:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346943360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574811.385351:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574811.385359:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346942848:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787574811.385393:0:24218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:3.0:1787574811.385422:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb9bc9 00000100:00100000:0.0:1787574811.385711:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346943360:12345-0@lo:400:kworker.0 Request processed in 1208us (7052us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.385719:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787574811.385741:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574811.385746:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3633:x1874407346942976:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787574811.385762:0:24217:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:0.0:1787574811.385780:0:24217:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd18a1efeeddb9bd0 00000100:00100000:2.0:1787574811.396459:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346942592:12345-0@lo:400:kworker.0 Request processed in 13009us (17857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.396475:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787574811.396568:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943232 00000100:00100000:2.0:1787574811.396577:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943232 00000100:00100000:2.0:1787574811.396623:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574811.396632:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346943232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.396717:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346943232:12345-0@lo:400:kworker.0 Request processed in 86us (13526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.396723:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787574811.396900:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943104 00000100:00100000:2.0:1787574811.396905:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943104 00000100:00100000:2.0:1787574811.396924:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943744 00000100:00100000:2.0:1787574811.396927:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943744 00000100:00100000:2.0:1787574811.396943:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346943872 00000100:00100000:2.0:1787574811.396946:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346943872 00000100:00100000:2.0:1787574811.396962:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574811.396968:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346943104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.397003:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346943104:12345-0@lo:400:kworker.0 Request processed in 35us (13905us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.397010:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787574811.397022:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574811.397029:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346943744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.397055:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1874407346943744:12345-0@lo:400:kworker.0 Request processed in 27us (13915us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.397061:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787574811.397073:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574811.397079:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574811.397105:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346943872:12345-0@lo:400:kworker.0 Request processed in 27us (13876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.397111:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787574811.397231:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346943232:0@lo:400:kworker.0 00010000:00080000:2.0:1787574811.397599:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503580e00 x1874407346943872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.397623:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346943872:0@lo:400:kworker.0 00010000:00080000:2.0:1787574811.397639:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503580700 x1874407346943104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.397649:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346943104:0@lo:400:kworker.0 00010000:00080000:2.0:1787574811.397659:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503580a80 x1874407346943744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.397667:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3636:1874407346943744:0@lo:400:kworker.0 00002000:00100000:3.0:1787574811.401368:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ca401a13000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787574811.401381:0:24218:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787574811.401384:0:24218:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787574811.401471:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787574811.401519:0:24218:0:(import.c:65:import_set_state_nolock()) ffff9ca401a13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574811.401609:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346942848:12345-0@lo:8:kworker.0 Request processed in 16247us (19026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574811.401621:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574811.401651:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574811.401658:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3633:x1874407346943488:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787574811.401691:0:24218:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 750 last 0 00000020:00000080:3.0:1787574811.401723:0:24218:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd18a1efeeddb9bd7 00002000:00100000:3.0:1787574811.401731:0:24218:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9ca401a10800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1787574811.401735:0:24218:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1787574811.401737:0:24218:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787574811.401900:0:24218:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1787574811.401926:0:24218:0:(import.c:65:import_set_state_nolock()) ffff9ca401a17000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787574811.401958:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3633:x1874407346943488:12345-0@lo:8:kworker.0 Request processed in 299us (19238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574811.401964:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787574811.401997:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787574811.402002:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574811.402005:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787574811.402718:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca4034de680 x1874407346942848/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.402742:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574811.402752:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787574811.402762:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574811.402768:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787574811.402771:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebea000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574811.402798:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574811.402805:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346942848:0@lo:8:kworker.0 00010000:00080000:2.0:1787574811.402821:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503583100 x1874407346943488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787574811.402831:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787574811.402835:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574811.402838:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787574811.402840:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca5350a5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574811.402849:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574811.402861:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3633:1874407346943488:0@lo:8:kworker.0 00000004:00080000:2.0:1787574811.402890:0:22735:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787574811.402950:0:22736:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000004:00080000:2.0:1787574811.402961:0:22735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 750585720616ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787574811.402967:0:22735:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1787574811.402970:0:22736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1874407346944384:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787574811.402988:0:23455:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787574811.403012:0:22736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787574811.403024:0:23455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 750585783927ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787574811.403028:0:23455:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787574811.403047:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346944256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574811.403049:0:22736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059a000 going to sleep for 11 seconds 00000004:00080000:3.0:1787574811.403071:0:23456:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1787574811.403075:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574811.403083:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346944640:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787574811.403099:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787574811.403104:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346944512:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574811.403106:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.403121:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574811.403127:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574811.403141:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944384 00000100:00100000:3.0:1787574811.403147:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944384 00000100:00100000:2.0:1787574811.403396:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944256 00000100:00100000:2.0:1787574811.403400:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944256 00000100:00100000:2.0:1787574811.403426:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944512 00000100:00100000:2.0:1787574811.403429:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944512 00000100:00100000:2.0:1787574811.403446:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574811.403454:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346944256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574811.403477:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574811.403616:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944640 00000100:00100000:3.0:1787574811.403620:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944640 00000100:00100000:3.0:1787574811.403636:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00002000:00100000:0.0:1787574811.404458:0:24217:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ca404095000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787574811.404466:0:24217:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787574811.404468:0:24217:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787574811.404528:0:24217:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574811.404556:0:24217:0:(import.c:65:import_set_state_nolock()) ffff9ca404097800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574811.404628:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3633:x1874407346942976:12345-0@lo:8:kworker.0 Request processed in 18878us (21962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.404636:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787574811.404668:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574811.404675:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23456:x1874407346944640:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1787574811.406900:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346944256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3440us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.406911:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787574811.406941:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787574811.406953:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1874407346944512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574811.406978:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574811.407010:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3636:x1874407346944512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.407026:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787574811.407078:0:3633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503583800 x1874407346942976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787574836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.407089:0:3633:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787574811.407098:0:3633:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1787574811.407108:0:3633:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787574811.407113:0:3633:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787574811.407116:0:3633:0:(import.c:65:import_set_state_nolock()) ffff9ca51ebec800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787574811.407141:0:3633:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787574811.407147:0:3633:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503583800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3633:1874407346942976:0@lo:8:kworker.0 00002000:00080000:0.0:1787574811.410400:0:24217:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1787574811.410411:0:24217:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787574811.410513:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23456:x1874407346944640:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5834us (7401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.410523:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787574811.410582:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346942592:0@lo:400:kworker.0 00010000:00080000:0.0:1787574811.410599:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca503581180 x1874407346943360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574811.410610:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503581180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346943360:0@lo:400:kworker.0 00000004:00080000:0.0:1787574811.410671:0:22737:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787574811.410758:0:22737:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 750593517293ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787574811.410763:0:22737:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:0.0:1787574811.410784:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787574811.410789:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787574811.411170:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74ea00 x1874407346944512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.411191:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346944512:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787574811.411204:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74e680 x1874407346944256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.411215:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346944256:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1787574811.411305:0:22738:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787574811.411324:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1874407346944896:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787574811.411363:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.411384:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230b540 going to sleep for 11 seconds 00000100:00100000:3.0:1787574811.412410:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22736:x1874407346944384:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787574811.413458:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787574811.413481:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346944768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574811.413723:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.413836:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944768 00000100:00100000:2.0:1787574811.413850:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944768 00000100:00100000:2.0:1787574811.413908:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574811.413919:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346944768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574811.413938:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574811.413980:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1874407346944768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.414004:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787574811.414047:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53f4f5500 x1874407346944768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787574827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.414079:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346944768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574811.414156:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346944896 00000100:00100000:2.0:1787574811.414161:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346944896 00000100:00100000:2.0:1787574811.414189:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574811.414196:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22738:x1874407346944896:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787574811.414348:0:23444:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:3.0:1787574811.415016:0:24215:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787574811.415024:0:24215:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1787574811.415029:0:24215:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00000100:00080000:0.0:1787574811.415141:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787574811.415318:0:23456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca52e74c380 x1874407346944640/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787574827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574811.415331:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346944640:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1787574811.415344:0:23456:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1787574811.415378:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346945024:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1787574811.415422:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574811.415445:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50315d6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1787574811.419352:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787574811.419847:0:24814:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787574811.419859:0:24814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1787574811.419965:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945024 00000100:00100000:2.0:1787574811.419975:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945024 00000100:00100000:2.0:1787574811.420191:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574811.420214:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23456:x1874407346945024:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1787574811.431499:0:24217:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1787574811.431517:0:24217:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1787574811.431524:0:24217:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:2.0:1787574811.432842:0:25205:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787574811.432943:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23456:x1874407346945024:12345-0@lo:5:osp-pre-1-1.0 Request processed in 12737us (17513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.432956:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787574811.433010:0:23456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca5317f7800 x1874407346945024/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787574827 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574811.433049:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5317f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346945024:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787574811.433063:0:23456:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787574811.433107:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346945152:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787574811.433139:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574811.433161:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230b240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574811.433178:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945152 00000100:00100000:2.0:1787574811.433184:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945152 00000100:00100000:2.0:1787574811.433221:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574811.433229:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23456:x1874407346945152:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787574811.433665:0:24814:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000004:00080000:2.0:1787574811.443200:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787574811.455458:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.455469:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.455486:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.455491:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.455496:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.455513:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.455524:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.455543:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.455574:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.459542:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.459554:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459569:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.459574:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459587:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459606:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459613:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc77831a/0xd18a1efeeddb9bde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459633:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.459635:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.459636:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.459723:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.459738:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459750:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.459754:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.459761:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459772:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459780:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459787:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.459808:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574811.459855:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574811.459862:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.459874:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.459878:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.459885:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.459910:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.459918:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9be5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.459932:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.459933:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.459935:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.461973:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.461985:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.461999:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.462004:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.462010:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462023:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462048:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462056:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462089:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.462447:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.462455:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.462464:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.462469:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.462478:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.462501:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.462508:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6ed1023/0xd18a1efeeddb9bec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.462526:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.462528:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.462529:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.462772:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.462779:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462788:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.462791:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.462795:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462811:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462819:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462827:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462844:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.462852:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.462857:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462863:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.462872:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462880:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462891:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462907:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9c32a6/0xd18a1efeeddb9bf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.462921:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.462923:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.462925:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.464103:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.464115:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464127:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.464132:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.464137:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464149:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464159:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464186:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464205:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.464215:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.464220:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464227:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fbe00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.464231:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464266:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464281:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464289:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000925f75cc/0xd18a1efeeddb9bfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464305:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.464307:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.464308:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.464951:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.464967:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464976:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.464979:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.464984:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.464994:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465002:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465009:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465023:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.465369:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.465376:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465384:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.465388:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465396:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465417:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465424:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022d5dcde/0xd18a1efeeddb9c01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.465438:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.465440:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.465442:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.466019:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.466027:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.466297:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.466301:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.466306:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.466317:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.466326:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.466334:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.466371:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.468492:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.468505:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.468517:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.468522:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.468532:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.468551:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.468558:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000960df935/0xd18a1efeeddb9c08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.468602:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.468604:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.468605:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574811.477846:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.477862:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.477879:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.477884:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.477891:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.477920:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.477946:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.477954:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.477977:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.478297:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.478305:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.478314:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.478319:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.478329:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.478347:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.478355:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9c0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.478375:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.478377:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.478379:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.480879:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.480895:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.480912:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.480917:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.480923:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.480936:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.480947:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.480956:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.480975:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.480986:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.480991:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.481009:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.481014:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.481023:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.481039:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.481047:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.481064:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.481066:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.481068:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.485515:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.485529:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485546:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.485560:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.485566:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485580:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485590:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485598:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485615:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.485626:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.485631:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485638:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.485643:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485652:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485668:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485685:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e855ea/0xd18a1efeeddb9c1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.485704:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.485705:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.485707:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.489894:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.489909:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.489925:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.489930:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.489937:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.489952:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.489961:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.489969:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.489990:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.490002:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.490015:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.490023:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.490028:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.490037:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.490054:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.490062:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a093c8a/0xd18a1efeeddb9c24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.490081:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.490083:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.490084:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.495660:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.495674:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.495691:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.495696:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.495702:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.496882:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.496895:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.496903:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787574811.497090:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.497097:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497107:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.497110:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.497115:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497124:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497132:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497138:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497159:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.497170:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.497176:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497183:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.497187:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497196:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497212:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497219:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d6a2127/0xd18a1efeeddb9c32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.497234:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.497235:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.497237:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.500129:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.500145:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.500152:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.500175:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd83000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.500179:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.500189:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.500209:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.500216:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000987c9c01/0xd18a1efeeddb9c2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.500236:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.500237:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.500265:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.505955:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.505970:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.505988:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.505992:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.505998:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506013:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506033:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506042:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506062:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.506075:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.506080:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506087:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.506091:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506100:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506115:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506122:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9c39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.506137:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.506144:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.506146:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.506946:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.506955:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.506968:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.506971:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.506976:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.506987:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.507002:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.507010:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.507031:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.509138:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.509151:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.509164:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.509169:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.509180:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.509202:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.509211:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a0102b5/0xd18a1efeeddb9c40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.509230:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.509231:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.509233:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.513236:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.513274:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514887:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.514893:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.514908:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514927:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514939:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514947:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514967:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.514980:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.514986:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.514994:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.514999:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.515008:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.515025:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.515043:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9c47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.515064:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.515066:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.515068:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.517227:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.517607:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.517624:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.517629:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.517635:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.517649:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.517659:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.517667:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.517711:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.518587:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.518594:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.518605:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.518610:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.518619:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.518638:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.518645:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d202e87/0xd18a1efeeddb9c4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.518665:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.518667:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.518669:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.520595:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.520609:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.520624:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.520629:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.520636:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.520648:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.520659:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.520667:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.520690:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.520873:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.520880:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.520888:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.520893:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.520902:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.520921:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.520928:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020eb9d97/0xd18a1efeeddb9c55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.520947:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.520949:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.520950:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.521622:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.521630:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.521663:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.521674:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.521679:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.521689:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.521697:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.521705:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.526504:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787574811.527065:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787574811.527075:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.527090:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574811.527095:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.527118:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.527137:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.527145:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcfa6fe7/0xd18a1efeeddb9c5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.527182:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.527184:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.527186:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.530794:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.530809:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530825:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.530829:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.530836:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530850:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530860:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530874:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530893:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.530906:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.530911:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530918:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.530923:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530932:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530949:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530955:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc77831a/0xd18a1efeeddb9c63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.530969:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.530971:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.530972:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.531015:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.531027:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.531035:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.531039:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.531043:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.531054:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.531061:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.531068:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.531088:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574811.533583:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.533596:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533612:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.533616:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.533622:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533635:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533657:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533665:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533682:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787574811.533694:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574811.533699:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533706:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.533710:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533731:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533747:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533754:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009211d1f2/0xd18a1efeeddb9c6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533774:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.533783:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533790:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.533793:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533801:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533811:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533819:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba893c17/0xd18a1efeeddb9c71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533830:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.533832:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.533834:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.533876:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.533881:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533891:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.533894:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.533899:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533921:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533928:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533935:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533947:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.533954:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.533957:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533963:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.533965:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533972:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533981:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.533988:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b8a9483/0xd18a1efeeddb9c78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.534007:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.534009:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.534011:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.535432:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.538124:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.538140:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538157:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.538161:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.538168:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538183:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538193:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538200:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538218:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.538230:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.538235:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538545:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.538550:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538558:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538574:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538581:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013c5ba37/0xd18a1efeeddb9c7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538599:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.538601:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.538602:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.538651:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.538656:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538665:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.538668:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.538672:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538682:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538695:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.538702:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539376:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.539390:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.539394:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539404:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.539408:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539416:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539429:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539438:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c5e6ef/0xd18a1efeeddb9c86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.539454:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.539462:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.539464:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.541838:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.541850:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541868:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.541872:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.541879:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541893:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541903:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541910:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541928:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.541938:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.541943:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541950:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.541954:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541976:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541991:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.541997:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0bbe24e/0xd18a1efeeddb9c8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542016:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.542017:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.542019:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.542061:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.542066:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542074:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.542077:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.542080:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542090:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542097:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542110:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542124:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.542132:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.542136:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542142:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.542145:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542152:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542163:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542169:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d23507be/0xd18a1efeeddb9c94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.542183:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.542184:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.542186:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.545645:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.545667:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.545683:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.545688:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.545694:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.545708:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.546400:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.546410:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561313:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.561342:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.561352:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561370:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.561376:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561389:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561418:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561426:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1ffe346/0xd18a1efeeddb9c9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.561448:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.561450:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.561452:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.562821:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.562832:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562847:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.562852:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.562859:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562874:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562885:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562893:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562926:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.562938:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.562944:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562951:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.562955:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562964:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562980:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.562988:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dcd9b0d/0xd18a1efeeddb9ca2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563004:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.563006:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.563007:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.563049:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.563054:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563062:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.563071:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.563075:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563085:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563094:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563100:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563112:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.563119:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.563122:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563128:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.563131:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563137:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563146:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563162:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029378004/0xd18a1efeeddb9ca9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563382:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.563384:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.563386:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.563812:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.563819:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563829:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.563833:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.563837:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563846:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563854:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563860:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.563881:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574811.564361:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.564373:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564381:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.564384:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.564388:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564398:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564406:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564414:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564427:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787574811.564436:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574811.564440:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564447:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f9e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.564451:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564461:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564481:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564487:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a0102b5/0xd18a1efeeddb9cb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564505:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.564508:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564516:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca52a4f8600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.564518:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564525:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564533:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564540:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc733d2c/0xd18a1efeeddb9cb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.564551:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.564552:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.564560:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.565424:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.565433:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565445:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.565448:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.565453:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565463:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565472:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565480:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565496:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.565506:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.565510:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565517:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.565521:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565539:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565551:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565558:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9cbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565573:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.565574:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.565576:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.565875:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.565881:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565890:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.565893:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.565897:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565906:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565913:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565926:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565938:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.565945:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787574811.565948:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565955:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.565958:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565966:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565975:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565982:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ea463fd/0xd18a1efeeddb9cc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.565993:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.565994:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.565996:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.566606:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.566614:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566624:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.566627:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.566632:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566642:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566650:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566662:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566681:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787574811.566978:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.566984:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.566992:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.566995:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.567000:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567008:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567016:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567023:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567031:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787574811.567359:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.567372:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.567380:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.567383:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.567387:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.567397:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.567404:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.567411:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.567419:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787574811.567643:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.567648:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567660:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.567663:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.567668:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567677:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567684:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567692:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.567699:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787574811.568098:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.568104:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.568113:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.568116:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.568120:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.568130:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.568148:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.568156:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568382:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787574811.568390:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568400:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.568405:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568413:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568430:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568437:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc84aab5/0xd18a1efeeddb9ccc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568456:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787574811.568466:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568473:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.568475:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568483:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568493:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568500:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c63a25d9/0xd18a1efeeddb9cd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568513:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574811.568517:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568523:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.568526:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568533:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574811.568580:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787574811.568580:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.568587:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568588:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddb9cda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.568595:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.568599:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787574811.568602:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787574811.568603:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568606:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568612:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.568613:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568615:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568623:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.568626:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568632:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.568634:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568640:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d6a2127/0xd18a1efeeddb9ce1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.568643:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787574811.568650:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574811.568653:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568663:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.568666:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568674:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568683:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568692:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.568694:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568700:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.568702:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568709:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568718:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568725:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060c089a7/0xd18a1efeeddb9cef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.568743:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.568745:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.568747:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.568806:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787574811.568811:0:24217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3f0f123/0xd18a1efeeddb9ce8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787574811.568876:0:25031:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1787574811.568891:0:25031:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1787574811.568895:0:25031:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1787574811.568912:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574811.569040:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23456:x1874407346945152:12345-0@lo:5:osp-pre-1-1.0 Request processed in 135808us (135896us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787574811.569051:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574811.569102:0:23456:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1787574811.569110:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23456:1874407346945152:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1787574811.569126:0:23456:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1787574811.569177:0:23456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23456:1874407346945280:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787574811.569213:0:23456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574811.569234:0:23456:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787574811.569286:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945280 00000100:00100000:1.0:1787574811.569293:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945280 00000100:00100000:1.0:1787574811.569330:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787574811.569339:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23456:x1874407346945280:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787574811.569385:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23456:x1874407346945280:12345-0@lo:900:osp-pre-1-1.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574811.569392:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787574811.569420:0:23456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53579f800 x1874407346945280/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787574827 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574811.569442:0:23456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23456:1874407346945280:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1787574811.569663:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.570431:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.570441:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.570454:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.570458:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.570463:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.570475:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.570490:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.570510:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.570530:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787574811.571624:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.571635:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.571647:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.571651:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.571656:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.571668:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.571677:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.571686:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.571703:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787574811.573378:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574811.573390:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573403:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.573408:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573419:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573444:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573452:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2bcde17/0xd18a1efeeddb9cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573485:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574811.573489:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573495:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.573499:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573505:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573516:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573523:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005663ca29/0xd18a1efeeddb9cfd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.573534:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.573536:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.573538:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.573544:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787574811.573586:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.573593:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.573611:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.573616:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.573622:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.573632:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.573641:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.573649:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.573670:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787574811.575467:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.575479:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.575553:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.575558:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.575563:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.575575:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.575596:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.575603:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.575622:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787574811.576048:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.576055:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576065:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.576068:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.576072:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576081:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576088:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576095:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576114:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1787574811.576655:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.576661:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576671:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.576674:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.576677:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576686:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576694:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576700:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.576709:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1787574811.577057:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.577064:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.577071:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.577079:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.577084:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.577093:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.577100:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.577107:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.577116:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787574811.577374:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.577381:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.577388:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.577391:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.577394:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.577404:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.577411:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.577419:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.577439:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1787574811.578439:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787574811.578449:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.578460:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=750s v=(0 0) 00010000:00010000:3.0:1787574811.578463:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787574811.578468:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.578478:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574811.578935:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.578942:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.578950:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.578953:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.578957:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.578967:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.578976:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.578996:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.579006:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1787574811.579186:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574811.579194:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.579982:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:1.0:1787574811.580339:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1787574811.580348:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580360:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580364:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580374:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580394:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580401:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007079dcfa/0xd18a1efeeddb9d04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580421:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787574811.580424:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580431:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580434:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580454:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580464:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580470:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001930c3ba/0xd18a1efeeddb9d0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580483:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787574811.580487:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580494:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580497:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580503:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580513:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580520:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2ae6c45/0xd18a1efeeddb9d12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580544:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787574811.580548:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580554:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580558:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580564:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580573:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580579:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdc80665/0xd18a1efeeddb9d19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580590:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787574811.580594:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580599:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580603:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580619:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580629:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580636:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d70fbc7/0xd18a1efeeddb9d20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580647:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787574811.580650:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580657:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580659:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580667:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580675:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580682:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c509034/0xd18a1efeeddb9d27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580705:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574811.580709:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580715:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580718:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580726:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580736:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580742:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a311005/0xd18a1efeeddb9d35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580754:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.580758:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580764:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19400 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.580767:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580783:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580793:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580801:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016414bdd/0xd18a1efeeddb9d2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.580813:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.580815:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.580817:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.581302:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.583195:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.583210:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583227:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.583232:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.583268:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583292:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583304:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583311:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583330:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574811.583340:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.583346:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.583353:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.583357:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.583365:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.583384:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.583407:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dba9a11/0xd18a1efeeddb9d3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.583425:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.583427:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.583429:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.583968:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.583983:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.583993:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.583997:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.584001:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584011:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584019:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584027:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584046:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574811.584292:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574811.584299:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.584318:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6000 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.584322:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.584330:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.584343:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.584351:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088e2e1d8/0xd18a1efeeddb9d43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.584367:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.584369:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.584370:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.584467:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.584472:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584492:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.584496:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.584500:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584509:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584523:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584530:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.584548:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574811.584578:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.584583:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.584590:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.584594:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.584601:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.584612:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.584619:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d92a9676/0xd18a1efeeddb9d4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.584633:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.584634:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.584636:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787574811.585054:0:24215:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.585060:0:24215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.585068:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.585071:0:24215:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.585076:0:24215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.585084:0:24215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.585091:0:24215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.585098:0:24215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.585132:0:24215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574811.585151:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574811.585155:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.585162:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.585165:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.585174:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.585193:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.585200:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002dc5729/0xd18a1efeeddb9d51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.585214:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.585216:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.585218:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787574811.586501:0:24215:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1787574811.586604:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22736:x1874407346944384:12345-0@lo:5:osp-pre-0-0.0 Request processed in 182956us (183586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574811.586615:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00002000:00010000:2.0:1787574811.586702:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.586709:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.586738:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.586742:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.586748:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.586761:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.586771:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.586779:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.586803:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574811.586958:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.586965:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.586974:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.586978:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.586987:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.587002:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.587008:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ea463fd/0xd18a1efeeddb9d58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.587044:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.587047:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.587048:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574811.588092:0:22736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1874407346944384:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787574811.588113:0:22736:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1787574811.588159:0:22736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1874407346945408:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787574811.588218:0:22736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574811.588274:0:22736:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518a18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574811.588662:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945408 00000100:00100000:2.0:1787574811.588675:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945408 00000100:00100000:2.0:1787574811.588733:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574811.588742:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22736:x1874407346945408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787574811.588780:0:24218:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:0.0:1787574811.589025:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.589048:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589063:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.589067:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.589072:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589084:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589093:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589100:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589126:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787574811.589136:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574811.589141:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589148:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574811.589153:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589163:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589180:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589188:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a97e946a/0xd18a1efeeddb9d5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.589204:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.589206:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574811.589208:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574811.591059:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.591072:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.591087:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.591098:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.591104:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.591117:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.591126:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.591133:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.591157:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787574811.594294:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.594309:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.594327:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.594331:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.594337:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.594351:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.594361:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.594376:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.594397:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00080000:3.0:1787574811.594430:0:24212:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787574811.594475:0:24212:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1787574811.594612:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574811.594619:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594628:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9c00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.594633:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594654:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594671:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594678:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f64158ad/0xd18a1efeeddb9d66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594701:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.594704:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594710:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.594713:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594721:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594730:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594736:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be54bb5b/0xd18a1efeeddb9d6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.594759:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.594761:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.594763:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574811.595659:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574811.595968:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22736:x1874407346945408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7220us (7743us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787574811.595979:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1787574811.598613:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.598627:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.598644:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.598648:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.598654:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.598667:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.598676:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.598683:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.598706:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787574811.600176:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787574811.600198:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.600213:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=750s v=(0 0) 00010000:00010000:2.0:1787574811.600217:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574811.600223:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.600236:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600321:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.600329:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600338:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7e00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.600342:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600352:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600370:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600377:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7ac6d93/0xd18a1efeeddb9d74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.600399:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.600401:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.600403:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.600494:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.600502:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.600552:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787574811.601908:0:22736:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1787574811.601924:0:22736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22736:1874407346945408:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787574811.601945:0:22736:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00002000:00010000:0.0:1787574811.602362:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.602371:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602385:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.602389:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.602396:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602408:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602418:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602425:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602450:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787574811.602465:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787574811.602471:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602506:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.602511:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602519:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602534:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602540:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005105172d/0xd18a1efeeddb9d7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602561:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.602564:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602570:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a8800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.602573:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602579:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602588:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602601:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042fff9f4/0xd18a1efeeddb9d82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602614:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.602616:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.602618:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.602708:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574811.602825:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.602831:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602846:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.602849:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.602853:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602862:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602869:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602876:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.602892:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787574811.602910:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787574811.602915:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602922:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c800 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574811.602926:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602934:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602945:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602952:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0c6d59/0xd18a1efeeddb9d89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574811.602964:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.602966:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574811.602968:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787574811.603201:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787574811.603207:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.603215:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=750s v=(0 0) 00010000:00010000:0.0:1787574811.603218:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574811.603222:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.603232:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.603280:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.603287:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574811.603305:0:24217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787574811.603338:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00080000:0.0:1787574811.603341:0:24217:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00010000:00010000:2.0:1787574811.603343:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.603350:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409de00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:2.0:1787574811.603354:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.603372:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.603383:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.603390:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d24f3d7/0xd18a1efeeddb9d90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574811.603402:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.603404:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574811.603405:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574811.603439:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22738:x1874407346944896:12345-0@lo:5:osp-pre-1-0.0 Request processed in 189240us (192071us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574811.603448:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574811.603459:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53f4f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1874407346944896:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787574811.603471:0:22738:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1787574811.603526:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1874407346945536:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787574811.603564:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574811.603595:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574811.603641:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945536 00000100:00100000:2.0:1787574811.603649:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945536 00000100:00100000:2.0:1787574811.603705:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574811.603724:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22738:x1874407346945536:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787574811.603759:0:24814:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:2.0:1787574811.614873:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22738:x1874407346945536:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11149us (11298us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1787574811.614888:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787574811.616463:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22738:1874407346945536:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787574811.616495:0:22738:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:1.0:1787574812.081484:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787574813.107543:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787574814.131388:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574814.449559:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346945664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787574814.449629:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574814.449710:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945664 00000100:00100000:1.0:1787574814.449717:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945664 00000100:00100000:1.0:1787574814.449771:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787574814.449781:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346945664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574814.449810:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574814.449856:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346945664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574814.449863:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787574814.449885:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574814.449925:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346945664:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1787574815.158417:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574815.479733:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346945792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574815.479810:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574815.479879:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945792 00000100:00100000:2.0:1787574815.479894:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945792 00000100:00100000:2.0:1787574815.479939:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574815.479948:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346945792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574815.479982:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574815.480024:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346945792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574815.480031:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787574815.480077:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346945792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574815.481992:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346945920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574815.482061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574815.482636:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346945920 00000100:00100000:0.0:1787574815.482645:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346945920 00000100:00100000:0.0:1787574815.482698:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787574815.482707:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346945920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787574815.482738:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787574815.488006:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346945920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5290us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574815.488020:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787574815.492935:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346945920:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787574815.678167:0:25390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg240-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787574816.180295:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574816.497617:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346946432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.497687:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.497732:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346946944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.497755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.497773:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346947456:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.497802:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.497824:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787574816.497830:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346946304:0@lo:400:kworker.0 00000100:00100000:3.0:1787574816.498066:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946432 00000100:00100000:3.0:1787574816.498073:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946432 00000100:00100000:3.0:1787574816.498125:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946944 00000100:00100000:3.0:1787574816.498128:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946944 00000100:00100000:3.0:1787574816.498153:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574816.498163:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346946432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574816.498227:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346946432:12345-0@lo:400:kworker.0 Request processed in 66us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574816.498235:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787574816.498300:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787574816.498306:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346946944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574816.498335:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346946944:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574816.498341:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787574816.498357:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574816.498516:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.498534:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346946816:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.498554:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.498764:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346947328:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.498790:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574816.498852:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346946432:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.498864:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346946944:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.498897:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946304 00000100:00100000:2.0:1787574816.498901:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946304 00000100:00100000:2.0:1787574816.498930:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946816 00000100:00100000:2.0:1787574816.498933:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946816 00000100:00100000:2.0:1787574816.498946:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574816.498953:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346946304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.498989:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346946304:12345-0@lo:400:kworker.0 Request processed in 36us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574816.498996:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787574816.499007:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574816.499014:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346946816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.499039:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346946816:12345-0@lo:400:kworker.0 Request processed in 27us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574816.499045:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787574816.499062:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947456 00000100:00100000:2.0:1787574816.499065:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947456 00000100:00100000:2.0:1787574816.499089:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947328 00000100:00100000:2.0:1787574816.499092:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947328 00000100:00100000:2.0:1787574816.499106:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574816.499112:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346947456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.499142:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1874407346947456:12345-0@lo:400:kworker.0 Request processed in 30us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574816.499148:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787574816.499159:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574816.499165:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346947328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.499199:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1874407346947328:12345-0@lo:400:kworker.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574816.499205:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787574816.499332:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346946304:0@lo:400:kworker.0 00000100:00100000:2.0:1787574816.499343:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346946816:0@lo:400:kworker.0 00010000:00080000:2.0:1787574816.499354:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40438ad80 x1874407346947328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574816.499365:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3637:1874407346947328:0@lo:400:kworker.0 00010000:00080000:2.0:1787574816.499375:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40438b480 x1874407346947456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574816.499384:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3637:1874407346947456:0@lo:400:kworker.0 00000100:00080000:3.0:1787574816.499498:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787574816.499502:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787574816.499504:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574816.499828:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346946048:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.499864:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.499906:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346946560:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.499928:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.499943:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346947072:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.499959:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.499971:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346947584:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.499992:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.500007:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1787574816.500012:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346946176:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500028:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.500045:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346946688:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500062:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.500075:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346947200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500092:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.500099:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574816.500114:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574816.500268:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946048 00000100:00100000:1.0:1787574816.500273:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946048 00000100:00100000:1.0:1787574816.500302:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787574816.500308:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346946048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500341:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346946048:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574816.500347:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787574816.500372:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946176 00000100:00100000:1.0:1787574816.500375:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946176 00000100:00100000:1.0:1787574816.500390:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946688 00000100:00100000:1.0:1787574816.500392:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946688 00000100:00100000:1.0:1787574816.500410:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574816.500414:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500440:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346946176:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574816.500445:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787574816.500454:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574816.500458:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346946688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.500476:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346946688:12345-0@lo:400:kworker.0 Request processed in 18us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574816.500601:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787574816.500621:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947712 00000100:00100000:1.0:1787574816.500623:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947712 00000100:00100000:1.0:1787574816.500638:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574816.500642:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346947712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574816.500659:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787574816.502998:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3634:x1874407346947712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2344us (2871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574816.503012:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787574816.503157:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346947840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787574816.503202:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574816.503286:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787574816.503294:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346947968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574816.503318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574816.503344:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947840 00000100:00100000:3.0:1787574816.503350:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947840 00000100:00100000:3.0:1787574816.503378:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947968 00000100:00100000:3.0:1787574816.503381:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947968 00000100:00100000:3.0:1787574816.503394:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574816.503402:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346947840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787574816.503428:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574816.503465:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346947840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574816.503471:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787574816.503497:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574816.503504:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346947968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787574816.503512:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574816.503540:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346947968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574816.503545:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787574816.503598:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346947968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787574816.503612:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346947840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574816.506647:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346946560 00000100:00100000:0.0:1787574816.506663:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346946560 00000100:00100000:0.0:1787574816.506706:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947072 00000100:00100000:0.0:1787574816.506710:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947072 00000100:00100000:0.0:1787574816.506722:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947584 00000100:00100000:0.0:1787574816.506725:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947584 00000100:00100000:0.0:1787574816.506749:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346947200 00000100:00100000:0.0:1787574816.506761:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346947200 00000100:00100000:0.0:1787574816.506797:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574816.506806:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346946560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574816.506902:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346946560:12345-0@lo:400:kworker.0 Request processed in 97us (6973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574816.506909:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787574816.506926:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574816.506931:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346947072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574816.506957:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53f4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346947072:12345-0@lo:400:kworker.0 Request processed in 26us (6997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574816.506962:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787574816.506972:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574816.506977:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346947584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574816.507003:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346947584:12345-0@lo:400:kworker.0 Request processed in 26us (7010us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574816.507009:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787574816.507019:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787574816.507024:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346947200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574816.507049:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346947200:12345-0@lo:400:kworker.0 Request processed in 25us (6956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574816.507055:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1787574816.508474:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574816.508484:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574816.508642:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346946176:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.508661:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346946688:0@lo:400:kworker.0 00010000:00080000:1.0:1787574816.508682:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389880 x1874407346947200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574816.508843:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346947200:0@lo:400:kworker.0 00000100:00100000:1.0:1787574816.508958:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346947712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574816.508990:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346946048:0@lo:400:kworker.0 00010000:00080000:1.0:1787574816.509003:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40438bb80 x1874407346946560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574816.509013:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346946560:0@lo:400:kworker.0 00010000:00080000:1.0:1787574816.509027:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389180 x1874407346947072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574816.509035:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346947072:0@lo:400:kworker.0 00010000:00080000:1.0:1787574816.509047:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389f80 x1874407346947584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574816.509056:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346947584:0@lo:400:kworker.0 00000020:00000004:1.0:1787574816.818593:0:25442:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574816.818813:0:25442:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787574817.203873:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787574817.527594:0:25031:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:1.0:1787574817.809807:0:25493:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787574817.810041:0:25493:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1787574818.111471:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.112204:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323749760 00000100:00100000:0.0:1787574818.112215:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323749760 00000100:00100000:2.0:1787574818.112480:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:2.0:1787574818.112489:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2401:x1874407323749760:12345-192.168.202.40@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787574818.112531:0:22706:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 88f0bcd3-417f-4999-8db3-d6d8197f2f2b@192.168.202.40@tcp t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:2.0:1787574818.112560:0:22706:0:(genops.c:1385:class_connect()) connect: client 88f0bcd3-417f-4999-8db3-d6d8197f2f2b, cookie 0xd18a1efeeddb9d97 00000100:00080000:2.0:1787574818.112708:0:22706:0:(import.c:65:import_set_state_nolock()) ffff9ca5372a0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574818.112786:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+5:2401:x1874407323749760:12345-192.168.202.40@tcp:250:mount.lustre.0 Request processed in 296us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.112794:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 115 00000100:00100000:3.0:1787574818.128712:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.129208:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323749888 00000100:00100000:0.0:1787574818.129332:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323749888 00000100:00100000:0.0:1787574818.129387:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1787574818.129398:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+5:18084:x1874407323749888:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574818.129428:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574818.129446:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb9d9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbf3 expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.129473:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb9d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbf3 expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.129484:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d600/0xd18a1efeeddb9d9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbf3 expref: 6 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.129625:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d600, rc 0) 00000100:00100000:0.0:1787574818.129691:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+6:18084:x1874407323749888:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 294us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.129699:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 116 00000100:00100000:0.0:1787574818.133463:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.133618:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750016 00000100:00100000:2.0:1787574818.133628:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750016 00000100:00100000:2.0:1787574818.133687:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1787574818.133698:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+6:18084:x1874407323750016:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574818.137115:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+6:18084:x1874407323750016:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 3394us (3638us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787574818.137137:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 117 00000100:00100000:2.0:1787574818.151173:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.151404:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750144 00000100:00100000:0.0:1787574818.151414:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750144 00000100:00100000:0.0:1787574818.151470:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1787574818.151479:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5045ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+6:18084:x1874407323750144:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574818.151503:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574818.151519:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d000/0xd18a1efeeddb9da5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bbfa expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.151547:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d000/0xd18a1efeeddb9da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbfa expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.151557:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d000/0xd18a1efeeddb9da5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bbfa expref: 7 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.151583:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d000, rc 0) 00000100:00100000:0.0:1787574818.151646:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5045ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+7:18084:x1874407323750144:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 167us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.151653:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 118 00000100:00100000:0.0:1787574818.165666:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.165772:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750272 00000100:00100000:2.0:1787574818.165783:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750272 00000100:00100000:2.0:1787574818.165841:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:2.0:1787574818.165851:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+7:18084:x1874407323750272:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574818.166007:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18084:x1874407323750272:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 157us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.166015:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 119 00000100:00100000:3.0:1787574818.171832:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574818.177664:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750400 00000100:00100000:1.0:1787574818.177681:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750400 00000100:00100000:1.0:1787574818.177758:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:1.0:1787574818.177770:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18084:x1874407323750400:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787574818.178344:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18084:x1874407323750400:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 575us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574818.178355:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 120 00000100:00100000:3.0:1787574818.196840:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.197320:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750528 00000100:00100000:0.0:1787574818.197331:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750528 00000100:00100000:0.0:1787574818.197393:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 121 00000100:00100000:0.0:1787574818.197404:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750528:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574818.197577:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750528:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 174us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.197586:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 121 00010000:00010000:1.0:1787574818.228341:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574818.234686:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574818.234787:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750656 00000100:00100000:1.0:1787574818.234811:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750656 00000100:00100000:1.0:1787574818.234867:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:1.0:1787574818.234878:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750656:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574818.235025:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750656:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 149us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574818.235034:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 122 00000100:00100000:3.0:1787574818.252025:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.252297:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750784 00000100:00100000:2.0:1787574818.252308:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750784 00000100:00100000:2.0:1787574818.252365:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:2.0:1787574818.252375:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca50554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750784:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574818.252545:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca50554d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18102:x1874407323750784:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 170us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.252553:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 123 00000100:00100000:3.0:1787574818.259474:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.259598:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323750912 00000100:00100000:0.0:1787574818.259608:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323750912 00000100:00100000:0.0:1787574818.259663:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1787574818.259673:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+8:18084:x1874407323750912:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574818.259689:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574818.259705:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb9dac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bc2b expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.259735:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb9dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc2b expref: 9 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.259747:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409dc00/0xd18a1efeeddb9dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc2b expref: 9 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.259764:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409dc00, rc 0) 00000100:00100000:0.0:1787574818.259823:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+9:18084:x1874407323750912:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.259831:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 124 00000100:00100000:0.0:1787574818.267015:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574818.267666:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751040 00000100:00100000:1.0:1787574818.267678:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751040 00000100:00100000:1.0:1787574818.267738:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:1.0:1787574818.267749:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+9:18084:x1874407323751040:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787574818.267776:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787574818.267799:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787574818.267803:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787574818.267807:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787574818.267809:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787574818.267812:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787574818.283625:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+9:18084:x1874407323751040:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 15866us (16608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574818.283641:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 125 00000100:00100000:3.0:1787574818.299391:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.299997:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751168 00000100:00100000:2.0:1787574818.300007:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751168 00000100:00100000:2.0:1787574818.300067:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:2.0:1787574818.300077:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+9:18084:x1874407323751168:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574818.300106:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574818.300122:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bc32 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574818.300159:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574818.300170:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 10 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574818.300179:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7a00, rc 0) 00000100:00100000:2.0:1787574818.300275:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18084:x1874407323751168:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 199us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.300282:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 126 00000100:00100000:1.0:1787574818.302735:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.303177:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751296 00000100:00100000:2.0:1787574818.303187:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751296 00000100:00100000:2.0:1787574818.303297:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:2.0:1787574818.303307:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca518181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18084:x1874407323751296:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787574818.303459:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca518181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18084:x1874407323751296:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 153us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.303468:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 127 00000100:00100000:3.0:1787574818.308682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.309204:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751424 00000100:00100000:0.0:1787574818.309215:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751424 00000100:00100000:0.0:1787574818.309318:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:0.0:1787574818.309329:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18084:x1874407323751424:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574818.309471:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18084:x1874407323751424:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 144us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.309479:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 128 00000100:00100000:1.0:1787574818.315913:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.316219:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751552 00000100:00100000:0.0:1787574818.316229:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751552 00000100:00100000:0.0:1787574818.316355:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:0.0:1787574818.316367:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18106:x1874407323751552:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574818.316535:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18106:x1874407323751552:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 170us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.316543:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 129 00000100:00100000:1.0:1787574818.331570:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.338374:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751680 00000100:00100000:2.0:1787574818.338388:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751680 00000100:00100000:2.0:1787574818.338450:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:2.0:1787574818.338460:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18106:x1874407323751680:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574818.340363:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18106:x1874407323751680:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 1892us (8863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.340394:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 130 00000100:00100000:3.0:1787574818.353593:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574818.353677:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.353832:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751808 00000100:00100000:0.0:1787574818.353843:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751808 00000100:00100000:0.0:1787574818.353887:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752064 00000100:00100000:0.0:1787574818.353890:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752064 00000100:00100000:0.0:1787574818.353904:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574818.353912:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874407323751808:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574818.353955:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:0.0:1787574818.354003:0:22711:0:(genops.c:1385:class_connect()) connect: client 67ff1a69-1def-49cc-a130-05878a5b0e46, cookie 0xd18a1efeeddb9dba 00000004:00100000:0.0:1787574818.354027:0:22711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574818.354235:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9ca404090000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574818.354327:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2401:x1874407323751808:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 414us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.354334:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574818.354352:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574818.354357:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2401:x1874407323752064:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787574818.354373:0:22711:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:0.0:1787574818.354401:0:22711:0:(genops.c:1385:class_connect()) connect: client 67ff1a69-1def-49cc-a130-05878a5b0e46, cookie 0xd18a1efeeddb9dc1 00000004:00100000:0.0:1787574818.354414:0:22711:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787574818.354572:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9ca404091000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574818.354597:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2401:x1874407323752064:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 238us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.354604:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1787574818.365720:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574818.365760:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574818.365788:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.365877:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752320 00000100:00100000:2.0:1787574818.365888:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752320 00000100:00100000:2.0:1787574818.365950:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752192 00000100:00100000:2.0:1787574818.365953:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752192 00000100:00100000:2.0:1787574818.365966:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323751936 00000100:00100000:2.0:1787574818.365969:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323751936 00000100:00100000:2.0:1787574818.365985:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1787574818.365995:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18084:x1874407323752320:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574818.366032:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574818.366111:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18084:x1874407323752320:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 118us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.366118:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:2.0:1787574818.366149:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1787574818.366157:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:0:x1874407323752192:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574818.366174:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574818.366232:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:0:x1874407323752192:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 75us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.366267:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1787574818.366281:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1787574818.366288:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:0:x1874407323751936:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574818.366299:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574818.366321:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:0:x1874407323751936:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 33us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.366327:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00080000:1.0:1787574818.368501:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574818.368512:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574818.383762:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.389848:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752448 00000100:00100000:2.0:1787574818.389864:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752448 00000100:00100000:2.0:1787574818.389966:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:2.0:1787574818.389977:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752448:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574818.390082:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752448:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 107us (6330us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574818.390089:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574818.417457:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574818.417508:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574818.417587:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.418018:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752576 00000100:00100000:0.0:1787574818.418027:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752576 00000100:00100000:0.0:1787574818.418062:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752704 00000100:00100000:0.0:1787574818.418065:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752704 00000100:00100000:0.0:1787574818.418089:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1787574818.418097:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323752576:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787574818.418141:0:24814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:0.0:1787574818.418172:0:24814:0:(genops.c:1385:class_connect()) connect: client 67ff1a69-1def-49cc-a130-05878a5b0e46, cookie 0xd18a1efeeddb9dc8 00002000:00100000:0.0:1787574818.418183:0:24814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 67ff1a69-1def-49cc-a130-05878a5b0e46/ffff9ca404093000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574818.418231:0:24814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574818.418481:0:24814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574818.418522:0:24814:0:(import.c:65:import_set_state_nolock()) ffff9ca404096000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574818.418586:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2401:x1874407323752576:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 487us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.418593:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:0.0:1787574818.418610:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1787574818.418615:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2401:x1874407323752704:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787574818.418631:0:24814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp t0 exp 0000000000000000 cur 757 last 0 00000020:00000080:0.0:1787574818.418647:0:24814:0:(genops.c:1385:class_connect()) connect: client 67ff1a69-1def-49cc-a130-05878a5b0e46, cookie 0xd18a1efeeddb9dcf 00002000:00100000:0.0:1787574818.418653:0:24814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 67ff1a69-1def-49cc-a130-05878a5b0e46/ffff9ca40222e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574818.418664:0:24814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574818.418809:0:24814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574818.418824:0:24814:0:(import.c:65:import_set_state_nolock()) ffff9ca40222a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574818.419117:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2401:x1874407323752704:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 499us (1607us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.419125:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574818.419450:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752832 00000100:00100000:1.0:1787574818.419457:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752832 00000100:00100000:1.0:1787574818.419533:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1787574818.419541:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752832:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787574818.419581:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752832:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 41us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574818.419589:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:1.0:1787574818.422123:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574818.422300:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323752960 00000100:00100000:2.0:1787574818.422310:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323752960 00000100:00100000:2.0:1787574818.422362:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:2.0:1787574818.422373:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752960:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00080000:3.0:1787574818.423780:0:22714:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1323us 00000004:00200000:3.0:1787574818.470963:0:22714:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787574818.471095:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18084:x1874407323752960:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 48718us (48986us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574818.471109:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000040:00080000:2.0:1787574818.610072:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574818.716678:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574818.716794:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753088 00000100:00100000:0.0:1787574818.716804:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753088 00000100:00100000:0.0:1787574818.716865:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:0.0:1787574818.716876:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18128:x1874407323753088:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:0.0:1787574818.716895:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574818.716921:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409cc00/0xd18a1efeeddb9dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bc63 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717008:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717021:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717035:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574818.717086:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787574818.717091:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574818.717127:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717170:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409cc00/0xd18a1efeeddb9dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc63 expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717218:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc63 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574818.717226:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:0.0:1787574818.717229:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574818.717232:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409da00, rc 0) 00000100:00100000:0.0:1787574818.717335:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18128:x1874407323753088:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 461us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574818.717342:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00010000:00010000:1.0:1787574819.249611:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574819.569616:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346948096:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574819.569696:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574819.569840:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948096 00000100:00100000:1.0:1787574819.569849:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948096 00000100:00100000:1.0:1787574819.569910:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574819.569921:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346948096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787574819.569940:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574819.569992:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346948096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574819.569999:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574819.570105:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca403744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346948096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574819.570305:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787574820.273482:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574820.593664:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346948224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787574820.593739:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574820.594000:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787574820.594010:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346948352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574820.594040:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574820.594346:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948224 00000100:00100000:3.0:1787574820.594356:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948224 00000100:00100000:3.0:1787574820.594410:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948352 00000100:00100000:3.0:1787574820.594413:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948352 00000100:00100000:3.0:1787574820.594429:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574820.594439:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346948224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787574820.594486:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787574820.594545:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346948224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574820.594552:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787574820.594567:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574820.594573:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346948352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574820.594588:0:22717:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574820.594620:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346948352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574820.594642:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787574820.594685:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346948352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787574820.594826:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346948224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574821.008728:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.008827:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753216 00000100:00100000:3.0:1787574821.008837:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753216 00000100:00100000:3.0:1787574821.008912:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:3.0:1787574821.008923:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18181:x1874407323753216:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:3.0:1787574821.008961:0:22712:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787574821.009054:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18181:x1874407323753216:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.009061:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00080000:2.0:1787574821.009446:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574821.011276:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.011444:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753344 00000100:00100000:2.0:1787574821.011456:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753344 00000100:00100000:2.0:1787574821.011527:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:2.0:1787574821.011538:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753344:12345-192.168.202.40@tcp:41:lfs.0 00000004:00000024:2.0:1787574821.011575:0:22713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574821.011665:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753344:12345-192.168.202.40@tcp:41:lfs.0 Request processed in 129us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.011672:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00080000:1.0:1787574821.012485:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574821.019979:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.020296:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753472 00000100:00100000:3.0:1787574821.020308:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753472 00000100:00100000:3.0:1787574821.020388:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:3.0:1787574821.020400:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753472:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:3.0:1787574821.020437:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574821.020531:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753472:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 133us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.020538:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00080000:1.0:1787574821.020984:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787574821.023721:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.023849:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753600 00000100:00100000:3.0:1787574821.023859:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753600 00000100:00100000:3.0:1787574821.023929:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:3.0:1787574821.023940:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5317f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753600:12345-192.168.202.40@tcp:13:lfs.0 00002000:00000024:3.0:1787574821.023971:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574821.024060:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5317f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18181:x1874407323753600:12345-192.168.202.40@tcp:13:lfs.0 Request processed in 121us (349us total) trans 0 rc 0/0 00000100:00080000:1.0:1787574821.024544:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787574821.024645:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1787574821.280102:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.280306:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753728 00000100:00100000:0.0:1787574821.280317:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753728 00000100:00100000:0.0:1787574821.280377:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:0.0:1787574821.280387:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+10:18215:x1874407323753728:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787574821.280403:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574821.280420:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bc6a expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574821.280447:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc6a expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574821.280458:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409d800/0xd18a1efeeddb9de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc6a expref: 11 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574821.280587:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409d800, rc 0) 00000100:00100000:0.0:1787574821.280647:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323753728:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 260us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.280655:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 131 00000100:00100000:2.0:1787574821.283523:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.283704:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753856 00000100:00100000:1.0:1787574821.283715:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753856 00000100:00100000:1.0:1787574821.283768:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:1.0:1787574821.283779:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323753856:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574821.283974:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323753856:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 195us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.283983:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 132 00000100:00100000:3.0:1787574821.287410:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.287814:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323753984 00000100:00100000:0.0:1787574821.287824:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323753984 00000100:00100000:0.0:1787574821.287879:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:0.0:1787574821.287889:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323753984:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574821.288036:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323753984:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 147us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.288046:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 133 00000100:00100000:3.0:1787574821.294623:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.295043:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754112 00000100:00100000:2.0:1787574821.295055:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754112 00000100:00100000:2.0:1787574821.295128:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 134 00000100:00100000:2.0:1787574821.295216:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754112:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574821.295407:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754112:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 194us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.295416:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 134 00010000:00010000:1.0:1787574821.297819:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574821.336304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.337736:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754240 00000100:00100000:1.0:1787574821.337750:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754240 00000100:00100000:1.0:1787574821.337818:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:1.0:1787574821.337828:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754240:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574821.337992:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754240:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 164us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.338000:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 135 00000100:00100000:3.0:1787574821.349509:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.349625:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754368 00000100:00100000:0.0:1787574821.349650:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754368 00000100:00100000:0.0:1787574821.349716:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1787574821.349727:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754368:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787574821.349881:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18218:x1874407323754368:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.349890:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 136 00000100:00100000:0.0:1787574821.354702:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.354806:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754496 00000100:00100000:2.0:1787574821.354817:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754496 00000100:00100000:2.0:1787574821.354880:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1787574821.354890:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18215:x1874407323754496:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574821.354906:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574821.354926:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f6200/0xd18a1efeeddb9deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bc9b expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.354955:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f6200/0xd18a1efeeddb9deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc9b expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.354966:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f6200/0xd18a1efeeddb9deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc9b expref: 12 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.354976:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f6200, rc 0) 00000100:00100000:2.0:1787574821.355045:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18215:x1874407323754496:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 156us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.355052:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 137 00000100:00100000:2.0:1787574821.363903:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.368303:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754624 00000100:00100000:1.0:1787574821.368323:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754624 00000100:00100000:1.0:1787574821.368406:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:1.0:1787574821.368418:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18215:x1874407323754624:12345-192.168.202.40@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787574821.368447:0:22705:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787574821.368474:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787574821.368484:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787574821.368487:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787574821.368489:0:22705:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1787574821.368492:0:22705:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787574821.377704:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18215:x1874407323754624:12345-192.168.202.40@tcp:256:mount.lustre.0 Request processed in 9264us (13786us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.377720:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 138 00000100:00100000:0.0:1787574821.386090:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.386200:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754752 00000100:00100000:2.0:1787574821.386210:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754752 00000100:00100000:2.0:1787574821.386302:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:2.0:1787574821.386312:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18215:x1874407323754752:12345-192.168.202.40@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787574821.386329:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574821.386347:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bca2 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.386377:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.386388:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.386398:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7600, rc 0) 00000100:00100000:2.0:1787574821.386459:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18215:x1874407323754752:12345-192.168.202.40@tcp:101:mount.lustre.0 Request processed in 148us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.386467:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 139 00000100:00100000:2.0:1787574821.390623:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.390772:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323754880 00000100:00100000:1.0:1787574821.390783:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323754880 00000100:00100000:1.0:1787574821.390882:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:1.0:1787574821.390892:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18215:x1874407323754880:12345-192.168.202.40@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787574821.391049:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53af7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18215:x1874407323754880:12345-192.168.202.40@tcp:501:mount.lustre.0 Request processed in 157us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.391058:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 140 00000100:00100000:3.0:1787574821.400106:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.400270:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755008 00000100:00100000:0.0:1787574821.400286:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755008 00000100:00100000:0.0:1787574821.400351:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:0.0:1787574821.400361:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18215:x1874407323755008:12345-192.168.202.40@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787574821.400525:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18215:x1874407323755008:12345-192.168.202.40@tcp:503:mount.lustre.0 Request processed in 165us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.400534:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 141 00000100:00100000:0.0:1787574821.411100:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.411299:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755136 00000100:00100000:1.0:1787574821.411311:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755136 00000100:00100000:1.0:1787574821.411370:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1787574821.411379:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18224:x1874407323755136:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787574821.411523:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18224:x1874407323755136:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 144us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.411533:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 142 00000100:00100000:1.0:1787574821.421815:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.421919:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755264 00000100:00100000:2.0:1787574821.421930:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755264 00000100:00100000:2.0:1787574821.421991:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:2.0:1787574821.422001:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18224:x1874407323755264:12345-192.168.202.40@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787574821.422173:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18224:x1874407323755264:12345-192.168.202.40@tcp:502:llog_process_th.0 Request processed in 162us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.422181:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 143 00000100:00100000:3.0:1787574821.440473:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.440639:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.440865:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755392 00000100:00100000:2.0:1787574821.440888:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755392 00000100:00100000:2.0:1787574821.440933:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755648 00000100:00100000:2.0:1787574821.440937:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755648 00000100:00100000:2.0:1787574821.440953:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574821.440961:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874407323755392:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787574821.440988:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 25d8d94f-1ce9-4a7b-bce1-12ff074de286@192.168.202.40@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:2.0:1787574821.441026:0:22713:0:(genops.c:1385:class_connect()) connect: client 25d8d94f-1ce9-4a7b-bce1-12ff074de286, cookie 0xd18a1efeeddb9df9 00000004:00100000:2.0:1787574821.441565:0:22713:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787574821.442183:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9ca5372a5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574821.442338:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2401:x1874407323755392:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 1374us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.442349:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:2.0:1787574821.442378:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:2.0:1787574821.442384:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2401:x1874407323755648:12345-192.168.202.40@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787574821.442405:0:22713:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 25d8d94f-1ce9-4a7b-bce1-12ff074de286@192.168.202.40@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:2.0:1787574821.442435:0:22713:0:(genops.c:1385:class_connect()) connect: client 25d8d94f-1ce9-4a7b-bce1-12ff074de286, cookie 0xd18a1efeeddb9e00 00000004:00100000:2.0:1787574821.442451:0:22713:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787574821.442522:0:22713:0:(import.c:65:import_set_state_nolock()) ffff9ca5372e4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787574821.442548:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2401:x1874407323755648:12345-192.168.202.40@tcp:38:mount.lustre.0 Request processed in 163us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.442555:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:0.0:1787574821.455017:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.455052:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.455205:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755904 00000100:00100000:2.0:1787574821.455215:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755904 00000100:00100000:2.0:1787574821.455309:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755776 00000100:00100000:2.0:1787574821.455312:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755776 00000100:00100000:2.0:1787574821.455329:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1787574821.455338:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323755904:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574821.455400:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574821.455462:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323755904:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 125us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.455469:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:2.0:1787574821.455486:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574821.455493:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:0:x1874407323755776:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574821.455505:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574821.455529:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:0:x1874407323755776:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 37us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.455536:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1787574821.455616:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.456175:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323755520 00000100:00100000:2.0:1787574821.456181:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323755520 00000100:00100000:2.0:1787574821.456217:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:2.0:1787574821.456225:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:0:x1874407323755520:12345-192.168.202.40@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787574821.456258:0:22711:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574821.456295:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:0:x1874407323755520:12345-192.168.202.40@tcp:41:mount.lustre.0 Request processed in 71us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.456301:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00080000:1.0:1787574821.456532:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574821.456537:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787574821.465832:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.466057:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756032 00000100:00100000:2.0:1787574821.466066:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756032 00000100:00100000:2.0:1787574821.466140:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574821.466151:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756032:12345-192.168.202.40@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787574821.466296:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756032:12345-192.168.202.40@tcp:40:mount.lustre.0 Request processed in 146us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.466321:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574821.475041:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.475094:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574821.475129:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574821.475341:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756160 00000100:00100000:0.0:1787574821.475352:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756160 00000100:00100000:0.0:1787574821.475397:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756288 00000100:00100000:0.0:1787574821.475401:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756288 00000100:00100000:0.0:1787574821.475421:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1787574821.475429:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874407323756160:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787574821.475463:0:24215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 25d8d94f-1ce9-4a7b-bce1-12ff074de286@192.168.202.40@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:0.0:1787574821.475506:0:24215:0:(genops.c:1385:class_connect()) connect: client 25d8d94f-1ce9-4a7b-bce1-12ff074de286, cookie 0xd18a1efeeddb9e07 00002000:00100000:0.0:1787574821.475519:0:24215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 25d8d94f-1ce9-4a7b-bce1-12ff074de286/ffff9ca537203800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574821.475530:0:24215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574821.475594:0:24215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787574821.475625:0:24215:0:(import.c:65:import_set_state_nolock()) ffff9ca537207000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574821.475700:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2401:x1874407323756160:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 269us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.475708:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:0.0:1787574821.475725:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1787574821.475730:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2401:x1874407323756288:12345-192.168.202.40@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787574821.475746:0:24215:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 25d8d94f-1ce9-4a7b-bce1-12ff074de286@192.168.202.40@tcp t0 exp 0000000000000000 cur 760 last 0 00000020:00000080:0.0:1787574821.475762:0:24215:0:(genops.c:1385:class_connect()) connect: client 25d8d94f-1ce9-4a7b-bce1-12ff074de286, cookie 0xd18a1efeeddb9e0e 00002000:00100000:0.0:1787574821.475767:0:24215:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 25d8d94f-1ce9-4a7b-bce1-12ff074de286/ffff9ca537204800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787574821.475773:0:24215:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787574821.475801:0:24215:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787574821.475841:0:24215:0:(import.c:65:import_set_state_nolock()) ffff9ca537353800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787574821.475865:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2401:x1874407323756288:12345-192.168.202.40@tcp:8:mount.lustre.0 Request processed in 133us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.475871:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:1.0:1787574821.476406:0:22723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756416 00000100:00100000:1.0:1787574821.476414:0:22723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756416 00000100:00100000:1.0:1787574821.476455:0:22723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574821.476471:0:22723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756416:12345-192.168.202.40@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787574821.476518:0:22723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756416:12345-192.168.202.40@tcp:900:mount.lustre.0 Request processed in 48us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.476525:0:22723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:3.0:1787574821.489323:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574821.490234:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756544 00000100:00100000:1.0:1787574821.490273:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756544 00000100:00100000:1.0:1787574821.490335:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574821.490346:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756544:12345-192.168.202.40@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787574821.490437:0:22715:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1787574821.490518:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18215:x1874407323756544:12345-192.168.202.40@tcp:33:mount.lustre.0 Request processed in 173us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.490526:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574821.619561:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346948736:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.619666:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574821.619747:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346949248:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.619771:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574821.619799:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000040:00080000:2.0:1787574821.620068:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574821.620150:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346948608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.620196:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574821.620227:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346949120:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.620277:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574821.620314:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948736 00000100:00100000:1.0:1787574821.620322:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948736 00000100:00100000:2.0:1787574821.620620:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949248 00000100:00100000:2.0:1787574821.620626:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949248 00000100:00100000:2.0:1787574821.620655:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787574821.621258:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574821.621269:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346949248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.621348:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346949248:12345-0@lo:400:kworker.0 Request processed in 81us (1575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.621356:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787574821.621382:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948608 00000100:00100000:1.0:1787574821.621387:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948608 00000100:00100000:1.0:1787574821.621413:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949120 00000100:00100000:1.0:1787574821.621416:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949120 00000100:00100000:1.0:1787574821.621430:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574821.621437:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346948608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.621472:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346948608:12345-0@lo:400:kworker.0 Request processed in 35us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.621478:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787574821.621492:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787574821.621498:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346949120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.621542:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346949120:12345-0@lo:400:kworker.0 Request processed in 44us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574821.621548:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787574821.621566:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574821.621609:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346948608:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.621621:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346949120:0@lo:400:kworker.0 00000100:00100000:1.0:1787574821.621632:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346949248:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.621897:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346948864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.621936:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.621958:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346949376:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.621976:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.621989:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346949888:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622017:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622037:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1787574821.622043:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346948480:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622068:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622259:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346948992:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622286:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622304:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346949504:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622323:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622335:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346950016:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622349:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622368:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346949632:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622410:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622422:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787574821.622427:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346949760:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622442:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574821.622463:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948864 00000100:00100000:0.0:1787574821.622468:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948864 00000100:00100000:0.0:1787574821.622499:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949376 00000100:00100000:0.0:1787574821.622502:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949376 00000100:00100000:0.0:1787574821.622515:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574821.622521:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346948864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622557:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346948864:12345-0@lo:400:kworker.0 Request processed in 36us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.622563:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787574821.622576:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574821.622583:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346949376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622628:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346949376:12345-0@lo:400:kworker.0 Request processed in 45us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574821.622634:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787574821.622661:0:3636:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787574821.622675:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346948864:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.622686:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346949376:0@lo:400:kworker.0 00000100:00100000:2.0:1787574821.622942:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346948736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574821.622987:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346948736:12345-0@lo:400:kworker.0 Request processed in 2324us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.622994:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787574821.623034:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949888 00000100:00100000:2.0:1787574821.623037:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949888 00000100:00100000:2.0:1787574821.623059:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948992 00000100:00100000:2.0:1787574821.623062:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948992 00000100:00100000:2.0:1787574821.623071:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949504 00000100:00100000:2.0:1787574821.623073:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949504 00000100:00100000:3.0:1787574821.623287:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346950144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574821.623342:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574821.623379:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950144 00000100:00100000:3.0:1787574821.623383:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950144 00000100:00100000:3.0:1787574821.623409:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574821.623415:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346950144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574821.623430:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574821.623466:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346950144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.623472:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574821.623511:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346950144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574821.623540:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950016 00000100:00100000:3.0:1787574821.623543:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950016 00000100:00100000:3.0:1787574821.623561:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949632 00000100:00100000:3.0:1787574821.623564:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949632 00000100:00100000:3.0:1787574821.623590:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346949760 00000100:00100000:3.0:1787574821.623594:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346949760 00000100:00100000:3.0:1787574821.623610:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574821.623617:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.623652:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346949888:12345-0@lo:400:kworker.0 Request processed in 36us (1633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.623658:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787574821.623670:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574821.623676:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346948992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.623722:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1874407346948992:12345-0@lo:400:kworker.0 Request processed in 46us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.623728:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787574821.623742:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574821.623748:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346950016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.623775:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1874407346950016:12345-0@lo:400:kworker.0 Request processed in 27us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.623780:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787574821.623791:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574821.623796:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346949632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.623971:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346949632:12345-0@lo:400:kworker.0 Request processed in 173us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.623978:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787574821.623993:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787574821.624000:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.624027:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346949760:12345-0@lo:400:kworker.0 Request processed in 28us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574821.624040:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1787574821.624073:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404054700 x1874407346949760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574821.624213:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787574821.624220:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346949504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574821.624268:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404055500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1874407346949504:12345-0@lo:400:kworker.0 Request processed in 49us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.624275:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1787574821.624370:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574821.624375:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574821.624378:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574821.624408:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346948480 00000100:00100000:2.0:1787574821.624413:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346948480 00000100:00100000:2.0:1787574821.624438:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787574821.624445:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3636:x1874407346948480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574821.624477:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3636:x1874407346948480:12345-0@lo:400:kworker.0 Request processed in 33us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.624491:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787574821.624528:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574821.624539:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574821.624566:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574821.624597:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950400 00000100:00100000:2.0:1787574821.624601:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950400 00000100:00100000:2.0:1787574821.624621:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574821.624626:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346950400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574821.624639:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574821.624668:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346950400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.624674:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574821.624717:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787574821.624994:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346950272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574821.625026:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574821.625060:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346948736:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.625218:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca503580700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346948480:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.625233:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3636:1874407346948992:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.625259:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3636:1874407346949504:0@lo:400:kworker.0 00010000:00080000:0.0:1787574821.625272:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404057800 x1874407346950016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574821.625282:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3636:1874407346950016:0@lo:400:kworker.0 00000100:00100000:0.0:1787574821.625292:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404057100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346949888:0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.625352:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346949760:0@lo:400:kworker.0 00000100:00100000:3.0:1787574821.625369:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346949632:0@lo:400:kworker.0 00000100:00100000:2.0:1787574821.625489:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950272 00000100:00100000:2.0:1787574821.625494:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950272 00000100:00100000:2.0:1787574821.625531:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787574821.625539:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346950272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574821.625551:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574821.625588:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346950272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.625594:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787574821.625842:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346950272:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574821.835329:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574821.835463:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756672 00000100:00100000:2.0:1787574821.835474:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756672 00000100:00100000:2.0:1787574821.835543:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:2.0:1787574821.835554:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18247:x1874407323756672:12345-192.168.202.40@tcp:101:mkdir.0 00010000:00010000:2.0:1787574821.835583:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574821.835607:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bcd3 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835673:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835703:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835716:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574821.835758:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787574821.835763:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574821.835785:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835812:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835830:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574821.835839:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:2.0:1787574821.835841:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574821.835844:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7000, rc 0) 00000100:00100000:2.0:1787574821.835897:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+7:18247:x1874407323756672:12345-192.168.202.40@tcp:101:mkdir.0 Request processed in 345us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574821.835904:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:1.0:1787574822.323553:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787574823.349346:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787574823.678691:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 25d8d94f-1ce9-4a7b-bce1-12ff074de286 00000001:00100000:0.0:1787574823.678703:0:22692:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 67ff1a69-1def-49cc-a130-05878a5b0e46 00000001:00100000:0.0:1787574823.678723:0:25031:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 25d8d94f-1ce9-4a7b-bce1-12ff074de286 00000001:00100000:0.0:1787574823.678728:0:25031:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 67ff1a69-1def-49cc-a130-05878a5b0e46 00000001:00100000:3.0:1787574823.679226:0:23444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 25d8d94f-1ce9-4a7b-bce1-12ff074de286 00000001:00100000:3.0:1787574823.679236:0:23444:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 67ff1a69-1def-49cc-a130-05878a5b0e46 00000001:00100000:3.0:1787574823.684555:0:24212:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 25d8d94f-1ce9-4a7b-bce1-12ff074de286 00000001:00100000:3.0:1787574823.684568:0:24212:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 67ff1a69-1def-49cc-a130-05878a5b0e46 00010000:00010000:1.0:1787574824.369554:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574824.690300:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346950528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574824.690390:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574824.691033:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950528 00000100:00100000:3.0:1787574824.691043:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950528 00000100:00100000:3.0:1787574824.691144:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787574824.691157:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346950528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574824.691191:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:1.0:1787574824.691436:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574824.699042:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1874407346950528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7878us (8641us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574824.699122:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787574824.700447:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3637:1874407346950528:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787574825.082857:0:25591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787574825.397970:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574825.713519:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787574825.720956:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346950784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574825.721073:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574825.721297:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950784 00000100:00100000:2.0:1787574825.721307:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950784 00000100:00100000:2.0:1787574825.721365:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787574825.721376:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346950784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574825.721411:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574825.721468:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346950784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574825.721475:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787574825.721607:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346950784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787574825.721616:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346950656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574825.721642:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574825.721826:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950656 00000100:00100000:2.0:1787574825.721831:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950656 00000100:00100000:2.0:1787574825.721863:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787574825.721870:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346950656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574825.721890:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574825.721933:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346950656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574825.721939:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787574825.722216:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346950656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787574826.418082:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574826.737437:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574826.737460:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346950912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574826.737526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.737592:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346950912 00000100:00100000:2.0:1787574826.737600:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346950912 00000100:00100000:2.0:1787574826.737657:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787574826.737667:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346950912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787574826.737709:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1787574826.737756:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346950912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.737764:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1787574826.737785:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787574826.737821:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346950912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574826.738551:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346951424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738594:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738636:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346951936:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738657:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738673:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346952448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738714:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738734:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1787574826.738742:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346951040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574826.738768:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738801:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346951680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574826.738822:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738838:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346952064:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738856:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738874:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346952576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738895:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738928:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346951168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.738957:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.738982:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346951552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.739020:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.739038:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346952192:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.739059:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.739069:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346952704:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.739088:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.739102:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1787574826.739108:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346951296:0@lo:400:kworker.0 00000100:00100000:3.0:1787574826.739299:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951424 00000100:00100000:3.0:1787574826.739307:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951424 00000100:00100000:3.0:1787574826.739348:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951936 00000100:00100000:3.0:1787574826.739352:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951936 00000100:00100000:3.0:1787574826.739370:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952064 00000100:00100000:3.0:1787574826.739373:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952064 00000100:00100000:3.0:1787574826.739387:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574826.739395:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346951424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574826.739470:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346951424:12345-0@lo:400:kworker.0 Request processed in 75us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574826.739477:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787574826.739492:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574826.739497:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346951936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574826.739521:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346951936:12345-0@lo:400:kworker.0 Request processed in 25us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574826.739527:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787574826.739536:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787574826.739542:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346952064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574826.739565:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346952064:12345-0@lo:400:kworker.0 Request processed in 23us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574826.739569:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574826.739900:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.739935:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346951808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.739956:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.740214:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346952320:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574826.740278:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952448 00000100:00100000:2.0:1787574826.740282:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952448 00000100:00100000:2.0:1787574826.740307:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952576 00000100:00100000:2.0:1787574826.740310:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952576 00000100:00100000:2.0:1787574826.740339:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951552 00000100:00100000:2.0:1787574826.740341:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951552 00000100:00100000:2.0:1787574826.740352:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952192 00000100:00100000:2.0:1787574826.740354:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952192 00000100:00100000:2.0:1787574826.740363:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952704 00000100:00100000:2.0:1787574826.740365:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952704 00000100:00100000:2.0:1787574826.740373:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346952320 00000100:00100000:2.0:1787574826.740375:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346952320 00000100:00100000:2.0:1787574826.740384:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574826.740389:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346952448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740432:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346952448:12345-0@lo:400:kworker.0 Request processed in 43us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740448:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787574826.740463:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574826.740469:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346952576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740501:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346952576:12345-0@lo:400:kworker.0 Request processed in 33us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740507:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787574826.740518:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574826.740523:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346951552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740553:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1874407346951552:12345-0@lo:400:kworker.0 Request processed in 30us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740558:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787574826.740570:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574826.740575:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346952192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740613:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1874407346952192:12345-0@lo:400:kworker.0 Request processed in 38us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740619:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787574826.740631:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574826.740637:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346952704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740665:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1874407346952704:12345-0@lo:400:kworker.0 Request processed in 29us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740670:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787574826.740680:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574826.740685:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346952320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740708:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1874407346952320:12345-0@lo:400:kworker.0 Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740720:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787574826.740774:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951168 00000100:00100000:2.0:1787574826.740779:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951168 00000100:00100000:2.0:1787574826.740808:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574826.740814:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346951168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.740843:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346951168:12345-0@lo:400:kworker.0 Request processed in 29us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740849:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787574826.740884:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951040 00000100:00100000:2.0:1787574826.740887:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951040 00000100:00100000:2.0:1787574826.740902:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951680 00000100:00100000:2.0:1787574826.740904:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951680 00000100:00100000:2.0:1787574826.740920:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574826.740926:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346951040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787574826.740946:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574826.740975:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404388380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346951040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (2206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.740980:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787574826.740990:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787574826.740995:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346951680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787574826.741003:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1787574826.741023:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346951680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 29us (2201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.741028:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1787574826.741044:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574826.741048:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787574826.741057:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574826.741060:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574826.741099:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346951040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787574826.741131:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346951680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574826.741142:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346952064:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741152:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346952576:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741159:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346951424:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741172:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346951936:0@lo:400:kworker.0 00010000:00080000:2.0:1787574826.741187:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca404389f80 x1874407346952448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574826.741198:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404389f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346952448:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741265:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3634:1874407346952320:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741274:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346951168:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741284:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404239f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3634:1874407346951552:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.741293:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3634:1874407346952192:0@lo:400:kworker.0 00010000:00080000:2.0:1787574826.741304:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca40438bb80 x1874407346952704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574826.741313:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40438bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3634:1874407346952704:0@lo:400:kworker.0 00000100:00100000:0.0:1787574826.747789:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951296 00000100:00100000:0.0:1787574826.747807:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951296 00000100:00100000:2.0:1787574826.747937:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346951808 00000100:00100000:2.0:1787574826.747942:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346951808 00000100:00100000:2.0:1787574826.747965:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787574826.747985:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787574826.747989:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346951296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574826.747994:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346951808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574826.748108:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346951808:12345-0@lo:400:kworker.0 Request processed in 115us (8150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.748142:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787574826.750756:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca40423b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346951808:0@lo:400:kworker.0 00000100:00100000:2.0:1787574826.752335:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346951296:12345-0@lo:400:kworker.0 Request processed in 4338us (12425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.752351:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787574826.752466:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404238a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346951296:0@lo:400:kworker.0 00000100:00100000:1.0:1787574826.780601:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780805:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780837:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780854:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780884:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780900:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780920:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780938:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574826.780968:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757312 00000100:00100000:1.0:1787574826.780978:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757312 00000100:00100000:1.0:1787574826.781034:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757824 00000100:00100000:1.0:1787574826.781038:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757824 00000100:00100000:1.0:1787574826.781052:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757184 00000100:00100000:1.0:1787574826.781054:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757184 00000100:00100000:1.0:1787574826.781068:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757696 00000100:00100000:1.0:1787574826.781070:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757696 00000100:00100000:1.0:1787574826.781086:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1787574826.781095:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757312:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781196:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757312:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781205:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1787574826.781223:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1787574826.781231:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757824:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781281:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757824:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 51us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781288:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1787574826.781300:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574826.781306:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757184:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781327:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757184:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781333:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574826.781343:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1787574826.781349:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757696:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781370:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757696:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 21us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781375:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:1.0:1787574826.781506:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757056 00000100:00100000:1.0:1787574826.781510:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757056 00000100:00100000:1.0:1787574826.781532:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757568 00000100:00100000:1.0:1787574826.781534:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757568 00000100:00100000:1.0:1787574826.781546:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756928 00000100:00100000:1.0:1787574826.781549:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756928 00000100:00100000:1.0:1787574826.781571:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757440 00000100:00100000:1.0:1787574826.781574:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757440 00000100:00100000:1.0:1787574826.781587:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1787574826.781594:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757056:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781633:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323757056:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 38us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781640:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:1.0:1787574826.781652:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1787574826.781658:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757568:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781681:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323757568:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 23us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781688:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:1.0:1787574826.781699:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1787574826.781705:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2402:x1874407323756928:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781729:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2402:x1874407323756928:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781734:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:1.0:1787574826.781745:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:1.0:1787574826.781751:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2402:x1874407323757440:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574826.781771:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2402:x1874407323757440:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 20us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574826.781776:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00080000:1.0:1787574826.781837:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574826.781841:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574826.781843:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574826.781853:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574826.789206:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323756800 00000100:00100000:2.0:1787574826.789219:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323756800 00000100:00100000:2.0:1787574826.789350:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 146 00000100:00100000:2.0:1787574826.789362:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2402:x1874407323756800:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574826.789461:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2402:x1874407323756800:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 101us (8869us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574826.789469:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 146 00010000:00010000:2.0:1787574827.442547:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574828.465496:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574828.852855:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1787574829.446784:0:25738:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7b7f6af0 20000000:00000080:2.0:1787574829.446801:0:25738:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ca40441d800 uarg=0000000000000000 20000000:01000000:2.0:1787574829.446841:0:25738:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787574829.446847:0:25738:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787574829.446851:0:25738:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1787574829.447639:0:25739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1787574829.447841:0:25738:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787574829.455569:0:25738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787574829.455602:0:25738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455624:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455633:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455657:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455664:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455674:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455683:0:25738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455691:0:25738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455738:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455754:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 12 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.455770:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346952832:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574829.455867:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455876:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 12 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.455884:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346952960:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574829.455923:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.455932:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 23 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.455942:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953088:0@lo:104: 00000100:00100000:2.0:1787574829.455979:0:25738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574829.456938:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 23 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.456950:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 23 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.456962:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953216:0@lo:104: 00000100:00100000:2.0:1787574829.456993:0:25738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787574829.460353:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.460372:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 23 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.460386:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953344:0@lo:104: 00000100:00100000:2.0:1787574829.460438:0:25738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574829.460718:0:22695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953088 00000100:00100000:3.0:1787574829.460727:0:22695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953088 00000100:00100000:0.0:1787574829.460839:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574829.460923:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574829.460954:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323757952 00000100:00100000:0.0:1787574829.460958:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323757952 00010000:00010000:0.0:1787574829.460980:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 13 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574829.461004:0:22697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758080 00000100:00100000:0.0:1787574829.461007:0:22697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758080 00010000:00010000:0.0:1787574829.461019:0:22697:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 14 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574829.461050:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1787574829.461058:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+14:2405:x1874407323757952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574829.461071:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574829.461077:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 14 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.461106:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 14 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.461135:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574829.461180:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+14:2405:x1874407323757952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574829.461188:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:0.0:1787574829.461209:0:22697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:0.0:1787574829.461216:0:22697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2405:x1874407323758080:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574829.461223:0:22697:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574829.461228:0:22697:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 13 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.461236:0:22697:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 13 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.461266:0:22697:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574829.461285:0:22697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2405:x1874407323758080:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 70us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574829.461291:0:22697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1787574829.461808:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953216 00000100:00100000:1.0:1787574829.461814:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953216 00000100:00100000:1.0:1787574829.461840:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574829.461847:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:25738:x1874407346953088:12345-0@lo:104: 00010000:00010000:1.0:1787574829.461859:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574829.461918:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574829.461924:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:25738:x1874407346953088:12345-0@lo:104: Request processed in 78us (5946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574829.461931:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787574829.461945:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787574829.461950:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:25738:x1874407346953216:12345-0@lo:104: 00010000:00010000:1.0:1787574829.461957:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574829.461988:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574829.461992:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:25738:x1874407346953216:12345-0@lo:104: Request processed in 43us (5000us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574829.461998:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787574829.462055:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574829.462061:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462068:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fa200 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574829.462073:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462104:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574829.462116:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574829.462185:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574829.462226:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462233:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574829.462278:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462286:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fa200/0xd18a1efeeddb9b60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9b67 expref: -99 pid: 25030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462300:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574829.462303:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462308:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5421fb800 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574829.462311:0:22700:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462318:0:22700:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574829.462324:0:22700:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574829.462337:0:22700:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574829.462356:0:22700:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462361:0:22700:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574829.462377:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462384:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5421fb800/0xd18a1efeeddb9ac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9acd expref: -99 pid: 24211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.462394:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574829.462396:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574829.462397:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574829.462403:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574829.462417:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346953472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574829.462452:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574829.462497:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346953600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574829.462522:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574829.462551:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953472 00000100:00100000:0.0:1787574829.462556:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953472 00010000:00010000:0.0:1787574829.462575:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 24 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574829.462592:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953600 00000100:00100000:0.0:1787574829.462595:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953600 00010000:00010000:0.0:1787574829.462606:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 25 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574829.462631:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787574829.462638:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+25:3635:x1874407346953472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574829.462839:0:25738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 25 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.462850:0:25738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 25 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.462873:0:25738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953728:0@lo:104: 00000100:00100000:2.0:1787574829.462900:0:25738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574829.462910:0:25738:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231ed80 going to sleep for 11 seconds 00010000:00010000:2.0:1787574829.462932:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9df2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bca2 expref: 12 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.462944:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346952832:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574829.462955:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5372f7a00/0xd18a1efeeddb9db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc32 expref: 11 pid: 22706 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.462964:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346952960:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574829.462972:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953088:0@lo:104: 00000100:00100000:2.0:1787574829.462980:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953216:0@lo:104: 00000100:00100000:2.0:1787574829.463019:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574829.463028:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f82b38c-81e1-4088-8af8-2f43485ff140+25:3636:x1874407346953600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574829.463039:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574829.463044:0:25050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 25 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.463054:0:25050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 25 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.463067:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53bd82000/0xd18a1efeeddb9acd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9ac6 expref: 25 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.463078:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574829.463209:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953344 00000100:00100000:1.0:1787574829.463214:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953344 00000100:00100000:1.0:1787574829.463233:0:22696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953728 00000100:00100000:1.0:1787574829.463236:0:22696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953728 00000100:00100000:1.0:1787574829.463267:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574829.463273:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:25738:x1874407346953344:12345-0@lo:104: 00010000:00010000:1.0:1787574829.463283:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574829.463336:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787574829.463341:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+4:25738:x1874407346953344:12345-0@lo:104: Request processed in 69us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574829.463347:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787574829.463361:0:22696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787574829.463367:0:22696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:25738:x1874407346953728:12345-0@lo:104: 00010000:00010000:1.0:1787574829.463374:0:22696:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574829.463404:0:22696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787574829.463408:0:22696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+3:25738:x1874407346953728:12345-0@lo:104: Request processed in 42us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574829.463414:0:22696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787574829.463550:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574829.463556:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 24 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463565:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 24 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463577:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca53be75a00/0xd18a1efeeddb9b67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9b60 expref: 24 pid: 22707 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463586:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574829.463625:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:3635:x1874407346953472:12345-0@lo:103:ldlm_bl.0 Request processed in 988us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574829.463631:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787574829.463728:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f82b38c-81e1-4088-8af8-2f43485ff140+22:3636:x1874407346953600:12345-0@lo:103:ldlm_bl.0 Request processed in 701us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574829.463735:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787574829.463768:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953344:0@lo:104: 00000100:00100000:2.0:1787574829.463775:0:25738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25738:1874407346953728:0@lo:104: 00010000:00010000:2.0:1787574829.463799:0:25738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463848:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787574829.463854:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463861:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5035a9a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574829.463865:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463874:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574829.463881:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574829.463895:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574829.463928:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463935:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574829.463949:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463956:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca5035a9a00/0xd18a1efeeddb9a87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a8e expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463970:0:22701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574829.463974:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463980:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53bd82a00 already unused, calling callback (ffffffffc12c7c20) 10000000:00010000:0.0:1787574829.463983:0:22701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.463990:0:22701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787574829.463997:0:22701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787574829.464003:0:22701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787574829.464015:0:22701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.464021:0:22701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787574829.464038:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.464044:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.140@tcp lock: ffff9ca53bd82a00/0xd18a1efeeddb9a79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd18a1efeeddb9a80 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574829.464056:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574829.464058:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574829.464060:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574829.464071:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346953856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574829.464116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574829.464309:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346953472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574829.464332:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787574829.464337:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346953984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787574829.464364:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574829.464493:0:25050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953984 00000100:00100000:2.0:1787574829.464499:0:25050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953984 00010000:00010000:2.0:1787574829.464519:0:25050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 22 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574829.464581:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787574829.464590:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f82b38c-81e1-4088-8af8-2f43485ff140+22:3635:x1874407346953984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787574829.464600:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574829.464605:0:25050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 22 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.464614:0:25050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 22 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.464627:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5421fb200/0xd18a1efeeddb9a80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a79 expref: 22 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.464637:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787574829.464683:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3635:x1874407346953984:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574829.464690:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787574829.465470:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346953856 00000100:00100000:1.0:1787574829.465477:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346953856 00010000:00010000:1.0:1787574829.465499:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 21 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574829.465536:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787574829.465546:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:3637:x1874407346953856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787574829.465557:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574829.465562:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 21 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465574:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 21 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465589:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5035a8600/0xd18a1efeeddb9a8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd18a1efeeddb9a87 expref: 21 pid: 22705 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465615:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465624:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465659:0:22699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465666:0:22699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465673:0:22699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465680:0:22699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465685:0:22699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7200 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:3.0:1787574829.465689:0:22699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465697:0:22699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465710:0:22699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574829.465720:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574829.465760:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c55c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:3637:x1874407346953856:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574829.465774:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787574829.466052:0:25738:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.466061:0:25738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574829.466067:0:25738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ca5372f7200/0xd18a1efeeddb9e23 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574829.467310:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4f82b38c-81e1-4088-8af8-2f43485ff140:3637:1874407346953856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787574829.467356:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346953600:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574829.467372:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787574829.467693:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4f82b38c-81e1-4088-8af8-2f43485ff140:3635:1874407346953984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787574829.499405:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574829.809568:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346954112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787574829.809659:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574829.809943:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954112 00000100:00100000:3.0:1787574829.809952:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954112 00000100:00100000:3.0:1787574829.810020:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787574829.810032:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346954112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574829.810061:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574829.810130:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1874407346954112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574829.810138:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787574829.810305:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3635:1874407346954112:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787574829.810367:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787574830.513550:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574830.837331:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346954240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787574830.837451:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574830.837752:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954240 00000100:00100000:2.0:1787574830.837762:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954240 00000100:00100000:2.0:1787574830.837840:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787574830.837849:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346954240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787574830.837897:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787574830.837947:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346954240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574830.837955:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574830.838854:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346954240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574830.842900:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346954368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787574830.842980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574830.843416:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954368 00000100:00100000:2.0:1787574830.843427:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954368 00000100:00100000:2.0:1787574830.843498:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787574830.843508:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346954368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787574830.843573:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787574830.843652:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346954368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 145us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574830.843660:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787574830.843785:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346954368:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1787574831.025366:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787574831.025373:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca40222a000 from 13 10000000:01000000:2.0:1787574831.025379:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787574831.025443:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.025457:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.025469:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574831.025496:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787574831.025581:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574831.025715:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574831.032026:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954496 00000100:00100000:0.0:1787574831.032050:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954496 00000100:00100000:0.0:1787574831.032180:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787574831.032191:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+20:22709:x1874407346954496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787574831.032209:0:22707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574831.032233:0:22707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb9e31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9e2a expref: -99 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.032315:0:22707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb9e31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e2a expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.032325:0:22707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca40409cc00/0xd18a1efeeddb9e31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e2a expref: 21 pid: 22707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.032334:0:22707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409cc00, rc 0) 00000100:00100000:0.0:1787574831.032417:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (6835us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.032423:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787574831.032569:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574831.032599:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e31 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.032609:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9e31 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574831.032687:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.032723:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.032766:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574831.035698:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954624 00000100:00100000:3.0:1787574831.035713:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954624 00000100:00100000:3.0:1787574831.035788:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787574831.035799:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.036042:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.036061:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787574831.038397:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.038467:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.038548:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.038591:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574831.039007:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954752 00000100:00100000:3.0:1787574831.039015:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954752 00000100:00100000:3.0:1787574831.039095:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787574831.039104:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.039230:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.039237:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787574831.040164:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787574831.062934:0:25751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787574831.074165:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787574831.074202:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787574831.074213:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e31 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.074226:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca5372f7a00/0xd18a1efeeddb9e2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e31 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787574831.074256:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787574831.074260:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca53509f800 from 13 10000000:01000000:1.0:1787574831.074262:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787574831.074320:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.074329:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.074340:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574831.074363:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.074426:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.074631:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574831.074724:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346954880 00000100:00100000:3.0:1787574831.074731:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346954880 00000100:00100000:3.0:1787574831.074778:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787574831.074787:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+21:22709:x1874407346954880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574831.074798:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574831.074810:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9e3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9e38 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.074833:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e38 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.074843:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e18a00/0xd18a1efeeddb9e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e38 expref: 22 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.074853:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e18a00, rc 0) 00000100:00100000:3.0:1787574831.074894:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346954880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.074900:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787574831.075323:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346954880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574831.075338:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e3f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.075347:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9e3f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574831.075404:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.075442:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.075465:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787574831.075662:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955008 00000100:00100000:0.0:1787574831.075667:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955008 00000100:00100000:0.0:1787574831.075700:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787574831.075707:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346955008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.075840:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346955008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.075847:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787574831.076140:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.076172:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.076218:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.076281:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.076358:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955136 00000100:00100000:2.0:1787574831.076363:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955136 00000100:00100000:2.0:1787574831.076391:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787574831.076397:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346955136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574831.076497:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346955136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.076503:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787574831.077176:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574831.078932:0:25752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787574831.079698:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787574831.079722:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574831.079735:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e3f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.079746:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca53be74e00/0xd18a1efeeddb9e38 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e3f expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574831.079758:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574831.079760:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca50309d800 from 13 10000000:01000000:3.0:1787574831.079763:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574831.079805:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.079822:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.079833:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.079857:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.079927:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574831.079968:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca506646000 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.081865:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955264 00000100:00100000:2.0:1787574831.081880:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955264 00000100:00100000:2.0:1787574831.081951:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787574831.081962:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+22:22709:x1874407346955264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574831.081978:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.081998:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9e4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9e46 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.082051:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e46 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.082063:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f7600/0xd18a1efeeddb9e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e46 expref: 23 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.082072:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7600, rc 0) 00000100:00100000:2.0:1787574831.082148:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.082155:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787574831.083422:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574831.083458:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e4d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.083469:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9e4d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574831.083564:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.083628:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.083671:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787574831.083861:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955392 00000100:00100000:0.0:1787574831.083868:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955392 00000100:00100000:0.0:1787574831.083913:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787574831.083922:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.084057:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca541ff0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.084065:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787574831.084338:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.084368:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.084416:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.085144:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40230ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1787574831.085235:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955520 00000100:00100000:3.0:1787574831.085275:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955520 00000100:00100000:3.0:1787574831.085319:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787574831.085329:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.085463:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.085471:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787574831.086978:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca535d45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787574831.090844:0:25753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787574831.091388:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787574831.091413:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787574831.091426:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e4d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.091452:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e18600/0xd18a1efeeddb9e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e4d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787574831.091465:0:22709:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787574831.091468:0:22709:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ca404bb1800 from 13 10000000:01000000:3.0:1787574831.091470:0:22709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787574831.091543:0:22709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.091552:0:22709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.091564:0:22709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.091604:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.092421:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574831.092500:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca509b72d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.101501:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955648 00000100:00100000:2.0:1787574831.101694:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955648 00000100:00100000:3.0:1787574831.101842:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787574831.101854:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+23:22709:x1874407346955648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787574831.101871:0:22705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574831.101896:0:22705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb9e5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd18a1efeeddb9e54 expref: -99 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.101925:0:22705:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb9e5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e54 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.101935:0:22705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca509e19400/0xd18a1efeeddb9e5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd18a1efeeddb9e54 expref: 24 pid: 22705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.101944:0:22705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19400, rc 0) 00000100:00100000:3.0:1787574831.102177:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346955648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (9757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.102184:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787574831.109535:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787574831.109576:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e5b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.109599:0:22709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd18a1efeeddb9e5b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574831.109775:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.109853:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.109899:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5219196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.110646:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955776 00000100:00100000:2.0:1787574831.110656:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955776 00000100:00100000:2.0:1787574831.110705:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787574831.110716:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346955776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787574831.110874:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346955776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 159us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.110882:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787574831.110969:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.111016:0:22709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.111072:0:22709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.111112:0:22709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5219196c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574831.112580:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346955904 00000100:00100000:3.0:1787574831.112615:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346955904 00000100:00100000:3.0:1787574831.112669:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787574831.112678:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346955904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787574831.112811:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4f82b38c-81e1-4088-8af8-2f43485ff140+24:22709:x1874407346955904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.112818:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787574831.113282:0:22709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404054e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4f82b38c-81e1-4088-8af8-2f43485ff140:22709:1874407346955904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787574831.116289:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787574831.116761:0:22709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787574831.116789:0:22709:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.140@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787574831.116800:0:22709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e5b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.116812:0:22709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.140@tcp lock: ffff9ca509e19800/0xd18a1efeeddb9e54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd18a1efeeddb9e5b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.118420:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.119261:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758208 00000100:00100000:2.0:1787574831.119273:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758208 00000100:00100000:2.0:1787574831.119325:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:2.0:1787574831.119334:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+11:18098:x1874407323758208:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574831.119352:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.119372:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f7400/0xd18a1efeeddb9e62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bcda expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.119421:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f7400/0xd18a1efeeddb9e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcda expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.119432:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f7400/0xd18a1efeeddb9e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcda expref: 12 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.119442:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7400, rc 0) 00000100:00100000:2.0:1787574831.119513:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758208:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 178us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.119520:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 159 00000100:00100000:0.0:1787574831.156545:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.156649:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758336 00000100:00100000:1.0:1787574831.156675:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758336 00000100:00100000:1.0:1787574831.156740:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:1.0:1787574831.156750:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758336:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787574831.156903:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758336:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 154us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.156911:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 160 00000100:00100000:1.0:1787574831.165658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.165768:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758464 00000100:00100000:0.0:1787574831.165778:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758464 00000100:00100000:0.0:1787574831.165838:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:0.0:1787574831.165850:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758464:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.166020:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758464:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 172us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.166037:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 161 00000100:00100000:3.0:1787574831.173194:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.173418:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758592 00000100:00100000:2.0:1787574831.173428:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758592 00000100:00100000:2.0:1787574831.173497:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:2.0:1787574831.173508:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+12:18098:x1874407323758592:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787574831.173526:0:22706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.173546:0:22706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ca5372f6400/0xd18a1efeeddb9e69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bce1 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.173575:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ca5372f6400/0xd18a1efeeddb9e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bce1 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.173587:0:22706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ca5372f6400/0xd18a1efeeddb9e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bce1 expref: 13 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.173596:0:22706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f6400, rc 0) 00000100:00100000:2.0:1787574831.173663:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18098:x1874407323758592:12345-192.168.202.40@tcp:101:ll_cfg_requeue.0 Request processed in 157us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.173688:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 162 00000100:00100000:3.0:1787574831.178804:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.179282:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758720 00000100:00100000:1.0:1787574831.179294:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758720 00000100:00100000:1.0:1787574831.179361:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:1.0:1787574831.179557:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18098:x1874407323758720:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787574831.179783:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18098:x1874407323758720:12345-192.168.202.40@tcp:501:ll_cfg_requeue.0 Request processed in 409us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.179810:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 163 00000100:00100000:0.0:1787574831.194304:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.194487:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758848 00000100:00100000:2.0:1787574831.194498:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758848 00000100:00100000:2.0:1787574831.194560:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:2.0:1787574831.194571:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18098:x1874407323758848:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787574831.194723:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503090850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:18098:x1874407323758848:12345-192.168.202.40@tcp:503:ll_cfg_requeue.0 Request processed in 153us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.194731:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 164 00000100:00100000:0.0:1787574831.195350:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.195610:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323758976 00000100:00100000:2.0:1787574831.195617:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323758976 00000100:00100000:2.0:1787574831.195664:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:2.0:1787574831.195673:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+6:18718:x1874407323758976:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574831.195688:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.195709:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6600/0xd18a1efeeddb9e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bce8 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195785:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195799:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195811:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195826:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195846:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195853:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195932:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6000/0xd18a1efeeddb9e85 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195940:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6000/0xd18a1efeeddb9e85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.195946:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6000/0xd18a1efeeddb9e85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574831.195976:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787574831.195979:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787574831.196852:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6000/0xd18a1efeeddb9e85 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196871:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196878:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196885:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196891:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574831.196895:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196915:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196929:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:2.0:1787574831.196933:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574831.196938:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196944:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7200/0xd18a1efeeddb9e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196958:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196964:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196970:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196975:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f7c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:2.0:1787574831.196978:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196985:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.196992:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ca520575200) 00010000:00010000:2.0:1787574831.196994:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787574831.196997:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.197011:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9e7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.197505:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6600/0xd18a1efeeddb9e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bce8 expref: 8 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.197523:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6000/0xd18a1efeeddb9e85 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bce8 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.197531:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca520575900) 00010000:00010000:2.0:1787574831.197534:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787574831.197537:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f6000, rc 0) 00000100:00100000:2.0:1787574831.197598:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18718:x1874407323758976:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1926us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.197607:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00080000:3.0:1787574831.201206:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574831.217577:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.219352:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759104 00000100:00100000:0.0:1787574831.219366:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759104 00000100:00100000:0.0:1787574831.219443:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574831.219454:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18718:x1874407323759104:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787574831.219555:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18718:x1874407323759104:12345-192.168.202.40@tcp:900:lhsmtool_posix.0 Request processed in 103us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.219563:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574831.238504:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.241358:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759360 00000100:00100000:3.0:1787574831.241384:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759360 00000100:00100000:3.0:1787574831.241463:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:3.0:1787574831.241474:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18718:x1874407323759360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787574831.241495:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574831.241519:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9e8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bcef expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241598:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241613:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241624:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241639:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241665:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241672:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241830:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb9ea1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241839:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb9ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.241846:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb9ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574831.241857:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1787574831.242045:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242052:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242059:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242065:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574831.242069:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242086:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242118:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ca520575900) 00010000:00010000:3.0:1787574831.242121:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574831.242126:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242132:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9e93 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242146:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242152:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242157:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242162:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574831.242165:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242169:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242176:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9ca509d4d000) 00010000:00010000:3.0:1787574831.242178:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574831.242181:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.242186:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9e9a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.244554:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9e8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcef expref: 10 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.244581:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19600/0xd18a1efeeddb9ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcef expref: 9 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.244589:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca509d4dd00) 00010000:00010000:3.0:1787574831.244592:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574831.244596:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19600, rc 0) 00000100:00100000:3.0:1787574831.244738:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18718:x1874407323759360:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 3265us (6243us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1787574831.244748:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:1.0:1787574831.260778:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.260873:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759488 00000100:00100000:2.0:1787574831.260883:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759488 00000100:00100000:2.0:1787574831.260944:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574831.260955:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18718:x1874407323759488:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787574831.261070:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18718:x1874407323759488:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 117us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.261090:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:1.0:1787574831.273133:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.273443:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759616 00000100:00100000:3.0:1787574831.273453:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759616 00000100:00100000:2.0:1787574831.273653:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:2.0:1787574831.273665:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:18718:x1874407323759616:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1787574831.273833:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:3.0:1787574831.275889:0:22713:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2181us 00000100:00100000:1.0:1787574831.282938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.283035:0:22711:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787574831.283045:0:22711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787574831.286360:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759744 00000100:00100000:3.0:1787574831.286375:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759744 00000100:00100000:1.0:1787574831.286594:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:1.0:1787574831.286606:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18725:x1874407323759744:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574831.286632:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.286656:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9eaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bcf6 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286822:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286836:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286860:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286876:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286882:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286889:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286932:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286939:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286947:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286952:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.286957:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286964:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.286975:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:1.0:1787574831.286978:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.286983:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287008:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287019:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287025:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287030:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287036:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.287039:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287045:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287054:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.287056:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.287060:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287064:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ebd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287108:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9eaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcf6 expref: 10 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287129:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:1.0:1787574831.287132:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.287136:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9eaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcf6 expref: 10 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.287146:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75000, rc 0) 00000100:00100000:1.0:1787574831.287312:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18725:x1874407323759744:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 707us (4383us total) trans 0 rc 301/301 00000100:00100000:1.0:1787574831.287319:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1787574831.296537:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:18718:x1874407323759616:12345-192.168.202.40@tcp:59:lhsmtool_posix.0 Request processed in 22863us (23403us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.296563:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1787574831.301507:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.301613:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323759872 00000100:00100000:3.0:1787574831.301624:0:22720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323759872 00000100:00100000:3.0:1787574831.301679:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1787574831.301691:0:22720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18725:x1874407323759872:12345-192.168.202.40@tcp:700:lfs.0 00000100:00100000:3.0:1787574831.301794:0:22720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18725:x1874407323759872:12345-192.168.202.40@tcp:700:lfs.0 Request processed in 105us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.301801:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574831.304825:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.304908:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760128 00000100:00100000:3.0:1787574831.304920:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760128 00000100:00100000:3.0:1787574831.305002:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574831.305014:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18725:x1874407323760128:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:3.0:1787574831.305089:0:22711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574831.305117:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bc63 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.305138:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:3.0:1787574831.305143:0:22711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574831.305222:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.305631:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 5 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.305645:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.305685:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 5 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.305701:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 5 pid: 22711 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.305717:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346956032:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574831.305809:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4023f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.312016:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.312124:0:25050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760256 00000100:00100000:0.0:1787574831.312133:0:25050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760256 00010000:00010000:0.0:1787574831.312203:0:25050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 6 pid: 22711 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574831.312275:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:0.0:1787574831.312286:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2404:x1874407323760256:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574831.312301:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574831.312308:0:25050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 6 pid: 22711 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.312322:0:25050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 6 pid: 22711 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.312344:0:25050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:0.0:1787574831.312356:0:25050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.312365:0:25050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.312373:0:25050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.312392:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574831.312445:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2404:x1874407323760256:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 161us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.312453:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:3.0:1787574831.312805:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9e1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcd3 expref: 5 pid: 22711 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.312829:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4040a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346956032:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574831.312851:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.312860:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.312866:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.312889:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.312899:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.312907:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787574831.313320:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787574831.316151:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316173:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316194:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574831.316213:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015eab589 reply state 00000000c7a640a7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316268:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316276:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:3.0:1787574831.316279:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574831.316283:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787574831.316299:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787574831.316308:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316314:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316320:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316327:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574831.316331:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316339:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316351:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca534a4dd00) 00010000:00010000:3.0:1787574831.316353:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574831.316358:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316364:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ec4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787574831.316392:0:22711:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015eab589 reply state 00000000c7a640a7 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316400:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.316406:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca509d4d000) 00010000:00010000:3.0:1787574831.316408:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574831.316410:0:22711:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787574831.316505:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+10:18725:x1874407323760128:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 11488us (11687us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787574831.316514:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1787574831.448169:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.448271:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760384 00000100:00100000:1.0:1787574831.448282:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760384 00000100:00100000:1.0:1787574831.448348:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1787574831.448358:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+10:18733:x1874407323760384:12345-192.168.202.40@tcp:101:lctl.0 00010000:00010000:1.0:1787574831.448386:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.448408:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9ed9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bcfd expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448470:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ee0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448484:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448494:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.448548:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787574831.448552:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574831.448585:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448607:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9ed9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcfd expref: 12 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448623:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75200/0xd18a1efeeddb9ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bcfd expref: 11 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.448631:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.448634:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574831.448637:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75200, rc 0) 00000100:00100000:1.0:1787574831.448697:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+11:18733:x1874407323760384:12345-192.168.202.40@tcp:101:lctl.0 Request processed in 340us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.448704:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 29 00000100:00100000:1.0:1787574831.476007:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.476208:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760512 00000100:00100000:3.0:1787574831.476219:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760512 00000100:00100000:3.0:1787574831.476338:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:3.0:1787574831.476349:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:18734:x1874407323760512:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:3.0:1787574831.476369:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574831.476388:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd04 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476451:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb9eee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476464:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb9eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476475:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb9eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574831.476536:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787574831.476539:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787574831.476559:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb9eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476581:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd04 expref: 7 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476599:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19200/0xd18a1efeeddb9eee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd04 expref: 6 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.476609:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:3.0:1787574831.476611:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787574831.476614:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19200, rc 0) 00000100:00100000:3.0:1787574831.476687:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18734:x1874407323760512:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 332us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.476694:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 30 00000100:00100000:0.0:1787574831.483516:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.483936:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760640 00000100:00100000:1.0:1787574831.483946:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760640 00000100:00100000:1.0:1787574831.484011:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:1.0:1787574831.484022:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:18734:x1874407323760640:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574831.484042:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.484062:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9ef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd0b expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484133:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484161:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484172:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484185:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484192:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484198:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484317:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484325:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484333:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.484371:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787574831.484374:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574831.484398:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484410:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484425:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484432:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484438:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.484443:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484450:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484463:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.484466:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.484471:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484478:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484492:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484498:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484504:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484509:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.484518:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484525:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484533:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca509d4d000) 00010000:00010000:1.0:1787574831.484536:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.484539:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484545:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484571:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9ef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd0b expref: 8 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484585:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd0b expref: 7 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.484592:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:1.0:1787574831.484595:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574831.484597:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74a00, rc 0) 00000100:00100000:1.0:1787574831.484664:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404056680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+7:18734:x1874407323760640:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 643us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.484673:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 31 00000100:00100000:2.0:1787574831.490097:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.490201:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323760768 00000100:00100000:0.0:1787574831.490214:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323760768 00000100:00100000:0.0:1787574831.490325:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574831.490339:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:18734:x1874407323760768:12345-192.168.202.40@tcp:900:lfs.0 00000100:00100000:0.0:1787574831.490434:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:18734:x1874407323760768:12345-192.168.202.40@tcp:900:lfs.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.490443:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00080000:2.0:1787574831.490986:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574831.496053:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.496286:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323761024 00000100:00100000:1.0:1787574831.496297:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323761024 00000100:00100000:1.0:1787574831.496364:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1787574831.496375:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+7:18734:x1874407323761024:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574831.496411:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.496431:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd12 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.496538:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787574831.496640:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f11 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd12 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.496655:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.496658:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574831.496662:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd12 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.496693:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75a00, rc 0) 00000100:00100000:1.0:1787574831.496906:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4040a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+8:18734:x1874407323761024:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 532us (861us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787574831.496914:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 32 00000100:00100000:1.0:1787574831.509460:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.509692:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323761280 00000100:00100000:0.0:1787574831.509703:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323761280 00000100:00100000:0.0:1787574831.509952:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:0.0:1787574831.509963:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+8:18734:x1874407323761280:12345-192.168.202.40@tcp:36:lfs.0 00010000:00010000:0.0:1787574831.510027:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574831.510054:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f0a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd0b expref: 8 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.510105:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574831.510111:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574831.510136:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.510150:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.510159:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574831.510401:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005f88fcd reply state 00000000a5d9fb73 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.510415:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.510421:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574831.510424:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1787574831.510427:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787574831.510434:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1787574831.510522:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+9:18734:x1874407323761280:12345-192.168.202.40@tcp:36:lfs.0 Request processed in 560us (1072us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787574831.510530:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 33 00000100:00100000:2.0:1787574831.513365:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.513630:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323761536 00000100:00100000:3.0:1787574831.513640:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323761536 00000100:00100000:3.0:1787574831.513709:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574831.513720:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+9:18734:x1874407323761536:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:3.0:1787574831.513937:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+10:18734:x1874407323761536:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 218us (582us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787574831.513945:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574831.519110:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.519293:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323761792 00000100:00100000:1.0:1787574831.519303:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323761792 00000100:00100000:1.0:1787574831.519358:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:1.0:1787574831.519368:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+10:18734:x1874407323761792:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574831.519391:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.519411:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd19 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519494:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519514:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519526:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519537:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519543:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519550:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.519642:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787574831.519736:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519743:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519749:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519755:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.519760:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519767:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519789:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.519792:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.519797:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519803:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519817:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519823:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519829:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519833:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.519836:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519842:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519848:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca509d4d000) 00010000:00010000:1.0:1787574831.519850:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.519853:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519858:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519896:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd19 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519906:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.519908:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787574831.519911:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd19 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.519919:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75a00, rc 0) 00000100:00100000:1.0:1787574831.519991:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+11:18734:x1874407323761792:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 618us (885us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1787574831.519998:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 34 00000100:00100000:0.0:1787574831.523384:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.523499:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323761920 00000100:00100000:1.0:1787574831.523510:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323761920 00000100:00100000:1.0:1787574831.523567:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:1.0:1787574831.523576:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+11:18734:x1874407323761920:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:1.0:1787574831.523598:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.523618:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f42 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd20 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.523858:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.523872:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.523883:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.523917:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787574831.523920:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574831.523938:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.523963:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f42 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 13 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.523982:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 12 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.524129:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:1.0:1787574831.524132:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787574831.524135:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74400, rc 0) 00000100:00100000:1.0:1787574831.526287:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404057480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:18734:x1874407323761920:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 2399us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.526304:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 35 00000100:00100000:2.0:1787574831.533428:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.533513:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762048 00000100:00100000:3.0:1787574831.533523:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762048 00000100:00100000:3.0:1787574831.533583:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:3.0:1787574831.533593:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:18734:x1874407323762048:12345-192.168.202.40@tcp:37:lfs.0 00010000:00010000:3.0:1787574831.538458:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574831.539226:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:18734:x1874407323762048:12345-192.168.202.40@tcp:37:lfs.0 Request processed in 5623us (5983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.539278:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574831.550438:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.550550:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762304 00000100:00100000:1.0:1787574831.550560:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762304 00000100:00100000:1.0:1787574831.550614:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:1.0:1787574831.550625:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5219d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:18734:x1874407323762304:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574831.550996:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5219d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+13:18734:x1874407323762304:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 363us (561us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787574831.551004:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 4 00000100:00100000:2.0:1787574831.649440:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.649634:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762432 00000100:00100000:1.0:1787574831.649645:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762432 00000100:00100000:1.0:1787574831.649869:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:1.0:1787574831.649881:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+11:18740:x1874407323762432:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574831.649899:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.649917:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd27 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.649977:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650003:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650015:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650026:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650033:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650040:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650347:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f65 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650355:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650360:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574831.650401:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787574831.650404:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574831.650437:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f65 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650446:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650450:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650455:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650459:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.650461:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650466:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650475:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:1.0:1787574831.650477:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.650480:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650484:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddb9f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650493:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650503:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650507:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650509:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574831.650511:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650514:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650518:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca509d4d000) 00010000:00010000:1.0:1787574831.650520:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574831.650521:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650524:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddb9f5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650542:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd27 expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650550:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75000/0xd18a1efeeddb9f65 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd27 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574831.650555:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:1.0:1787574831.650557:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787574831.650562:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75000, rc 0) 00000100:00100000:1.0:1787574831.650611:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+12:18740:x1874407323762432:12345-192.168.202.40@tcp:101:bash.0 Request processed in 733us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.650616:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 36 00000100:00100000:3.0:1787574831.655391:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.655501:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762560 00000100:00100000:0.0:1787574831.655510:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762560 00000100:00100000:0.0:1787574831.655569:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574831.655580:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:18740:x1874407323762560:12345-192.168.202.40@tcp:900:bash.0 00000100:00100000:0.0:1787574831.655664:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:18740:x1874407323762560:12345-192.168.202.40@tcp:900:bash.0 Request processed in 85us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.655672:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574831.660053:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.660236:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762816 00000100:00100000:2.0:1787574831.660282:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762816 00000100:00100000:2.0:1787574831.660351:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1787574831.660360:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+12:18740:x1874407323762816:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574831.660381:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.660403:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6c00/0xd18a1efeeddb9f6c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd2e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.660524:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.660541:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 12 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.660548:0:22713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.660585:0:22713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 12 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.660618:0:22713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 12 pid: 25756 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574831.660634:0:22713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1874407346956160:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574831.660748:0:22713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574831.665055:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.665303:0:22713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22713:1874407346956160:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574831.665328:0:22713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.665855:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323762944 00000100:00100000:3.0:1787574831.665864:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323762944 00010000:00010000:3.0:1787574831.665907:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 13 pid: 25756 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574831.666311:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 16 00000100:00100000:3.0:1787574831.666324:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25d8d94f-1ce9-4a7b-bce1-12ff074de286+13:2404:x1874407323762944:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574831.666340:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574831.666347:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 13 pid: 25756 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666361:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 13 pid: 25756 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666383:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddb9f49 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd20 expref: 13 pid: 25756 timeout: 870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666401:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:3.0:1787574831.666406:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666417:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666438:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.666460:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574831.666529:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:2404:x1874407323762944:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 208us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.666537:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 16 00010000:00010000:0.0:1787574831.666749:0:22713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.666757:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.666813:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.666822:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.666829:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667365:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667387:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667394:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574831.667405:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574831.667432:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667439:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667445:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667452:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574831.667456:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667463:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667474:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574831.667476:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574831.667480:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667485:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddb9f73 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574831.667496:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087d973d1 reply state 000000002b373a6e transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667512:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667518:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ca534a4fc00) 00010000:00010000:0.0:1787574831.667521:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574831.667524:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787574831.667557:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6c00/0xd18a1efeeddb9f6c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 15 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667571:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 14 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.667578:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574831.667580:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787574831.667582:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ce00, rc 0) 00000100:00100000:0.0:1787574831.667638:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404054a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+15:18740:x1874407323762816:12345-192.168.202.40@tcp:101:bash.0 Request processed in 7279us (7597us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787574831.667645:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 37 00000100:00100000:2.0:1787574831.691560:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.691744:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323763072 00000100:00100000:1.0:1787574831.691756:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323763072 00000100:00100000:1.0:1787574831.691825:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:1.0:1787574831.691836:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+15:18740:x1874407323763072:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574831.691862:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574831.691886:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f8f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd35 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.695852:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.695877:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.695890:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574831.696295:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574831.696318:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574831.696348:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.696361:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.696404:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddb9f8f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd35 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.696427:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd35 expref: 16 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.696436:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574831.696439:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574831.696443:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c000, rc 0) 00000100:00100000:0.0:1787574831.696599:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+16:18740:x1874407323763072:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4764us (5048us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.696608:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 38 00000100:00100000:2.0:1787574831.706758:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.706976:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323763328 00000100:00100000:0.0:1787574831.706999:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323763328 00000100:00100000:0.0:1787574831.707064:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:0.0:1787574831.707089:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+16:18740:x1874407323763328:12345-192.168.202.40@tcp:35:bash.0 00000100:00100000:0.0:1787574831.707599:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+17:18740:x1874407323763328:12345-192.168.202.40@tcp:35:bash.0 Request processed in 523us (855us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1787574831.707608:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 5 00000100:00100000:2.0:1787574831.859747:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346956288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787574831.859867:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.860194:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787574831.860204:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346956416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574831.860237:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574831.860293:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956288 00000100:00100000:1.0:1787574831.860301:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956288 00000100:00100000:1.0:1787574831.860349:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956416 00000100:00100000:1.0:1787574831.860352:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956416 00000100:00100000:1.0:1787574831.860382:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574831.860393:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346956288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787574831.860419:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1787574831.860464:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346956288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.860470:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787574831.860489:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787574831.860495:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346956416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787574831.860528:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787574831.860558:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca403745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346956416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.860563:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787574831.860580:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574831.860584:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574831.860616:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca4034de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346956416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787574831.860631:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53be5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346956288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574831.861272:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346956544:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861318:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861360:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346957056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861400:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861418:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346957568:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861444:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861462:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1787574831.861468:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346956672:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861489:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861502:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346957184:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861523:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861538:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346957696:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861556:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574831.861584:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956544 00000100:00100000:0.0:1787574831.861590:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956544 00000100:00100000:0.0:1787574831.861628:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574831.861635:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3636:x1874407346956544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861676:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503091050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3636:x1874407346956544:12345-0@lo:400:kworker.0 Request processed in 41us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.861683:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787574831.861714:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957056 00000100:00100000:0.0:1787574831.861730:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957056 00000100:00100000:0.0:1787574831.861753:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956672 00000100:00100000:0.0:1787574831.861755:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956672 00000100:00100000:0.0:1787574831.861771:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574831.861776:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346957056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861810:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346957056:12345-0@lo:400:kworker.0 Request processed in 33us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.861826:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787574831.861840:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574831.861847:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346956672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861875:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346956672:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.861882:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787574831.861912:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404055180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346956672:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861921:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca404056300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4f82b38c-81e1-4088-8af8-2f43485ff140:3636:1874407346956544:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861928:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346957056:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.861954:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957568 00000100:00100000:0.0:1787574831.861957:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957568 00000100:00100000:0.0:1787574831.862225:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957696 00000100:00100000:0.0:1787574831.862229:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957696 00000100:00100000:0.0:1787574831.862284:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787574831.862291:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346957568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.862329:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1874407346957568:12345-0@lo:400:kworker.0 Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.862336:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1787574831.862362:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8f800 x1874407346957568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787574831.862384:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3636:1874407346957568:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.862404:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574831.862410:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.862453:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1874407346957696:12345-0@lo:400:kworker.0 Request processed in 44us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.862459:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787574831.862484:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3636:1874407346957696:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863140:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346956928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863186:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574831.863223:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346957440:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863274:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574831.863295:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1787574831.863302:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346956800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863329:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574831.863347:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346957312:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863382:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787574831.863394:0:3635:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346957824:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.863413:0:3635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787574831.864468:0:23465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787574831.864567:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957184 00000100:00100000:1.0:1787574831.864577:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957184 00000100:00100000:1.0:1787574831.864631:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956800 00000100:00100000:1.0:1787574831.864634:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956800 00000100:00100000:1.0:1787574831.864660:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574831.864671:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346957184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.864765:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346957184:12345-0@lo:400:kworker.0 Request processed in 96us (3240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.864776:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787574831.864793:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787574831.864800:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346956800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.864831:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40438bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1874407346956800:12345-0@lo:400:kworker.0 Request processed in 32us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.864837:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787574831.864860:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574831.864865:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574831.864867:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574831.864880:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574831.864896:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346956928 00000100:00100000:1.0:1787574831.864899:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346956928 00000100:00100000:1.0:1787574831.864916:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957440 00000100:00100000:1.0:1787574831.864919:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957440 00000100:00080000:1.0:1787574831.864934:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787574831.864944:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957312 00000100:00100000:1.0:1787574831.864947:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957312 00000100:00100000:1.0:1787574831.864956:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957824 00000100:00100000:1.0:1787574831.864958:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957824 00000100:00080000:1.0:1787574831.864968:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787574831.864982:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574831.864988:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346956928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.865021:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1874407346956928:12345-0@lo:400:kworker.0 Request processed in 33us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.865027:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787574831.865038:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787574831.865044:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346957440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.865080:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1874407346957440:12345-0@lo:400:kworker.0 Request processed in 25us (1795us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.865086:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787574831.865098:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574831.865104:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346957312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.865130:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1874407346957312:12345-0@lo:400:kworker.0 Request processed in 26us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.865135:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787574831.865145:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787574831.865151:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346957824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574831.865187:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1874407346957824:12345-0@lo:400:kworker.0 Request processed in 37us (1773us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.865193:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787574831.867435:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3635:1874407346956800:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.867454:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3635:1874407346957312:0@lo:400:kworker.0 00010000:00080000:2.0:1787574831.867494:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca53bf8d500 x1874407346957824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574831.867505:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3635:1874407346957824:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.867518:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3635:1874407346956928:0@lo:400:kworker.0 00000100:00100000:2.0:1787574831.867531:0:3635:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3635:1874407346957440:0@lo:400:kworker.0 00000100:00100000:3.0:1787574831.868065:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787574831.868091:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787574831.868156:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574831.868199:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346957952 00000100:00100000:3.0:1787574831.868206:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346957952 00000100:00100000:3.0:1787574831.868284:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574831.868293:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346957952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787574831.868317:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1787574831.868359:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346957952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.868376:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787574831.868414:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53579fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346957952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787574831.868950:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.869188:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346957184:0@lo:400:kworker.0 00000100:00100000:0.0:1787574831.869216:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323763584 00000100:00100000:0.0:1787574831.869221:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323763584 00000100:00100000:0.0:1787574831.869298:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:0.0:1787574831.869308:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+17:18750:x1874407323763584:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574831.869326:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574831.869347:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb9f9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd3c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574831.869451:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574831.869552:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb9f9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd3c expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.869566:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574831.869569:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574831.869573:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddb9f9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd3c expref: 19 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.869586:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409de00, rc 0) 00000100:00100000:0.0:1787574831.869633:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+18:18750:x1874407323763584:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 327us (686us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1787574831.869640:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 39 00000100:00100000:2.0:1787574831.882817:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.882861:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.882897:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.882924:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764352 00000100:00100000:2.0:1787574831.882934:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764352 00000100:00100000:2.0:1787574831.882993:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:2.0:1787574831.883005:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764352:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574831.883092:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764352:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.883100:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00080000:2.0:1787574831.883122:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574831.883151:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.883219:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.883275:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.883296:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.883316:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.883333:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764864 00000100:00100000:2.0:1787574831.883338:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764864 00000100:00100000:0.0:1787574831.883479:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323763840 00000100:00100000:0.0:1787574831.883484:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323763840 00000100:00100000:0.0:1787574831.883515:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574831.883523:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+18:18750:x1874407323763840:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574831.883710:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18750:x1874407323763840:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 187us (903us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1787574831.883717:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 6 00000100:00100000:0.0:1787574831.883784:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764096 00000100:00100000:0.0:1787574831.883789:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764096 00000100:00100000:0.0:1787574831.883812:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764608 00000100:00100000:0.0:1787574831.883815:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764608 00000100:00100000:0.0:1787574831.883826:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764480 00000100:00100000:0.0:1787574831.883828:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764480 00000100:00100000:0.0:1787574831.883841:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574831.883848:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764096:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574831.883881:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764096:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 34us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.883887:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:0.0:1787574831.883899:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1787574831.883905:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764608:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574831.883929:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764608:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 24us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.883935:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1787574831.883947:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1787574831.883954:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:2404:x1874407323764480:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574831.883979:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+12:2404:x1874407323764480:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.884001:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1787574831.884081:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1787574831.884090:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764864:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574831.884120:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764864:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.884126:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1787574831.884158:0:22706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323763968 00000100:00100000:0.0:1787574831.884163:0:22706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323763968 00000100:00100000:0.0:1787574831.884188:0:22706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00100000:0.0:1787574831.884194:0:22706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2404:x1874407323763968:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574831.884219:0:22706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2404:x1874407323763968:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.884226:0:22706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 166 00000100:00080000:0.0:1787574831.884305:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574831.886513:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764224 00000100:00100000:2.0:1787574831.886543:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764224 00000100:00100000:2.0:1787574831.886673:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574831.886685:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764224:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574831.886762:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404239500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323764224:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 80us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574831.886770:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00080000:3.0:1787574831.886827:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574831.886888:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574831.898829:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323764736 00000100:00100000:1.0:1787574831.898844:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323764736 00000100:00100000:1.0:1787574831.898929:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:1.0:1787574831.898941:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53579fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764736:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:1.0:1787574831.899033:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53579fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2404:x1874407323764736:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 93us (12144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574831.899041:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00080000:3.0:1787574831.900894:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1787574831.922094:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787574831.951819:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574831.951933:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323765120 00000100:00100000:2.0:1787574831.951945:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323765120 00000100:00100000:2.0:1787574831.952015:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:2.0:1787574831.952026:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18753:x1874407323765120:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:2.0:1787574831.952056:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574831.952093:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9fab lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd43 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.952218:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9fb2 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.952232:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9fb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.952289:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9fb2 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787574831.952303:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787574831.952433:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7c00/0xd18a1efeeddb9fab lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd43 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.952451:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9fb2 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd43 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574831.952474:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:2.0:1787574831.952476:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787574831.952480:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7000, rc 0) 00000100:00100000:2.0:1787574831.953049:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18753:x1874407323765120:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 1021us (1239us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1787574831.953058:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 40 00000100:00100000:1.0:1787574831.962910:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.963026:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323765248 00000100:00100000:0.0:1787574831.963037:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323765248 00000100:00100000:0.0:1787574831.963103:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:0.0:1787574831.963114:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18753:x1874407323765248:12345-192.168.202.40@tcp:54:lfs.0 00010000:00010000:0.0:1787574831.963185:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963202:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963214:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963310:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963318:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963326:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963331:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574831.963336:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963344:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963358:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574831.963361:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574831.963365:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574831.963371:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574831.963723:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574831.963790:0:25050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323765376 00000100:00100000:3.0:1787574831.963795:0:25050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323765376 00000100:00100000:3.0:1787574831.963835:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:3.0:1787574831.963844:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+22:2405:x1874407323765376:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574831.963864:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574831.963881:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f7000/0xd18a1efeeddb9fb2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd43 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574831.963894:0:25050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574831.963898:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574831.963943:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+21:2405:x1874407323765376:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574831.963951:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:0.0:1787574831.964176:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca4034de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+20:18753:x1874407323765248:12345-192.168.202.40@tcp:54:lfs.0 Request processed in 1062us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574831.964185:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 41 00000100:00100000:1.0:1787574831.971479:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574831.972083:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323765632 00000100:00100000:0.0:1787574831.972094:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323765632 00000100:00100000:0.0:1787574831.972156:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:0.0:1787574831.972182:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+20:18753:x1874407323765632:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:0.0:1787574831.972489:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18753:x1874407323765632:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 308us (1021us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1787574831.972498:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 7 00000100:00100000:1.0:1787574832.333557:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574832.333669:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323765888 00000100:00100000:0.0:1787574832.333741:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323765888 00000100:00100000:0.0:1787574832.333855:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:0.0:1787574832.333866:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18784:x1874407323765888:12345-192.168.202.40@tcp:101:cat.0 00010000:00010000:0.0:1787574832.333890:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574832.333909:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd4a expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.334012:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9fce lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.334026:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9fce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.334038:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9fce lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574832.334049:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574832.334187:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9fc7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd4a expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.334207:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9fce lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd4a expref: 23 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.334235:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574832.334281:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574832.334286:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c400, rc 0) 00000100:00100000:0.0:1787574832.334349:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+23:18784:x1874407323765888:12345-192.168.202.40@tcp:101:cat.0 Request processed in 485us (801us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1787574832.334357:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 42 00000100:00100000:2.0:1787574832.339812:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574832.340016:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574832.340340:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323766144 00000100:00100000:0.0:1787574832.340352:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323766144 00000100:00100000:0.0:1787574832.340419:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:0.0:1787574832.340430:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+23:18784:x1874407323766144:12345-192.168.202.40@tcp:35:cat.0 00000100:00100000:0.0:1787574832.340703:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca404238e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+24:18784:x1874407323766144:12345-192.168.202.40@tcp:35:cat.0 Request processed in 274us (898us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1787574832.340712:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 8 00000100:00100000:1.0:1787574832.344877:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323766272 00000100:00100000:1.0:1787574832.344897:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323766272 00000100:00100000:1.0:1787574832.344994:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:1.0:1787574832.345005:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+24:2404:x1874407323766272:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574832.345024:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574832.345050:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddb9fce lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd4a expref: 24 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574832.345080:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574832.345086:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574832.345473:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca40423a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+23:2404:x1874407323766272:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 467us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574832.345501:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 1 00000100:00100000:2.0:1787574832.459410:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574832.459583:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323766528 00000100:00100000:3.0:1787574832.459593:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323766528 00000100:00100000:3.0:1787574832.459663:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:3.0:1787574832.459674:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+23:18790:x1874407323766528:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:3.0:1787574832.459699:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574832.459719:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fdc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd51 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.459826:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9fe3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.459841:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9fe3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.459853:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9fe3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787574832.459865:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787574832.459990:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fdc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd51 expref: 26 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.460020:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9fe3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd51 expref: 25 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.460029:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574832.460032:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787574832.460035:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19000, rc 0) 00000100:00100000:3.0:1787574832.460115:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537341500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+25:18790:x1874407323766528:12345-192.168.202.40@tcp:101:dd.0 Request processed in 442us (715us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1787574832.460123:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 43 00000100:00100000:2.0:1787574832.464742:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574832.464788:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574832.464941:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323766656 00000100:00100000:0.0:1787574832.464951:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323766656 00000100:00100000:0.0:1787574832.465013:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:0.0:1787574832.465024:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+25:18790:x1874407323766656:12345-192.168.202.40@tcp:101:dd.0 00010000:00010000:0.0:1787574832.465060:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574832.465090:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9ff1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd58 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465149:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465163:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465189:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465357:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddb9ff1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 27 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465392:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 26 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.465401:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574832.465405:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574832.465408:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409da00, rc 0) 00000100:00100000:0.0:1787574832.465467:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537341180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+26:18790:x1874407323766656:12345-192.168.202.40@tcp:101:dd.0 Request processed in 445us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574832.465475:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 44 00000100:00100000:3.0:1787574832.467882:0:25050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323766784 00000100:00100000:3.0:1787574832.467898:0:25050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323766784 00000100:00100000:3.0:1787574832.467965:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:3.0:1787574832.467976:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+26:2402:x1874407323766784:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574832.467992:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574832.468016:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddb9fe3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd51 expref: 26 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.468049:0:25050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574832.468054:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574832.468353:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+25:2402:x1874407323766784:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 378us (3563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574832.468439:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 2 00000100:00100000:2.0:1787574832.470028:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574832.470445:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323767040 00000100:00100000:3.0:1787574832.470456:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323767040 00000100:00100000:3.0:1787574832.470512:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 45 00000100:00100000:3.0:1787574832.470538:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+25:18790:x1874407323767040:12345-192.168.202.40@tcp:36:dd.0 00010000:00010000:3.0:1787574832.470591:0:25756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574832.470616:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddb9f96 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd35 expref: 25 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.470635:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574832.470639:0:25756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787574832.470930:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.470945:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.470954:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787574832.471206:0:25756:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1787574832.471662:0:25756:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b3d57c1 reply state 00000000da18b29a transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.471677:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574832.471684:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574832.471687:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787574832.471690:0:25756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787574832.472257:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537343b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+27:18790:x1874407323767040:12345-192.168.202.40@tcp:36:dd.0 Request processed in 1702us (2218us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1787574832.472267:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 45 00000020:00080000:3.0:1787574832.472272:0:25756:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787574832.565015:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574832.617199:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574832.617864:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323767296 00000100:00100000:3.0:1787574832.617875:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323767296 00000100:00100000:3.0:1787574832.617951:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:3.0:1787574832.617961:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+27:18790:x1874407323767296:12345-192.168.202.40@tcp:35:dd.0 00000100:00100000:3.0:1787574832.618444:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+28:18790:x1874407323767296:12345-192.168.202.40@tcp:35:dd.0 Request processed in 482us (1256us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787574832.618452:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 9 00000100:00100000:1.0:1787574832.962363:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574832.962701:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323767424 00000100:00100000:0.0:1787574832.962712:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323767424 00000100:00100000:0.0:1787574832.962777:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:0.0:1787574832.962788:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+28:18804:x1874407323767424:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:0.0:1787574832.962823:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574832.962845:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba006 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd5f expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.962940:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.962973:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.962987:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963015:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963023:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963029:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963134:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963143:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963150:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574832.963194:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574832.963198:0:22711:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574832.963286:0:22711:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963299:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963318:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963324:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963330:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963336:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574832.963340:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963346:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963358:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574832.963361:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574832.963366:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963372:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba00d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963386:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963392:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963397:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963408:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574832.963411:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963417:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963427:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ca534a4fc00) 00010000:00010000:0.0:1787574832.963429:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574832.963432:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963438:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba014 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963470:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba006 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd5f expref: 30 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963482:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd5f expref: 29 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574832.963490:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574832.963493:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574832.963495:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c400, rc 0) 00000100:00100000:0.0:1787574832.963566:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+29:18804:x1874407323767424:12345-192.168.202.40@tcp:101:stat.0 Request processed in 780us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574832.963574:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 46 00000100:00100000:2.0:1787574833.074146:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.074272:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323767680 00000100:00100000:0.0:1787574833.074297:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323767680 00000100:00100000:0.0:1787574833.074380:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 47 00000100:00100000:0.0:1787574833.074391:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+29:18810:x1874407323767680:12345-192.168.202.40@tcp:36:truncate.0 00010000:00010000:0.0:1787574833.074447:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574833.074474:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba01b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd5f expref: 29 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.074494:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.074498:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574833.074654:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.074668:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.074685:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574833.074721:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:0.0:1787574833.074741:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c75c861b reply state 00000000c5f693cd transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.074753:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.074760:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.074762:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574833.074765:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574833.074873:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537342d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+31:18810:x1874407323767680:12345-192.168.202.40@tcp:36:truncate.0 Request processed in 483us (736us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1787574833.074879:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 47 00000020:00080000:0.0:1787574833.074892:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1787574833.077190:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787574833.319457:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.319544:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323767808 00000100:00100000:0.0:1787574833.319552:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323767808 00000100:00100000:0.0:1787574833.319601:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:0.0:1787574833.319609:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+31:18824:x1874407323767808:12345-192.168.202.40@tcp:101:stat.0 00010000:00010000:0.0:1787574833.319628:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574833.319644:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba029 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd66 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319697:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319716:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319724:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319734:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319741:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319747:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319822:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319829:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319848:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574833.319880:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1787574833.319883:0:22712:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574833.319896:0:22712:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319904:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319909:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319914:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319918:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319922:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.319924:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319930:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319941:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574833.319944:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574833.319948:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319963:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba030 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319977:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319982:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319987:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.319992:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.319995:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320001:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320008:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ca534a4fc00) 00010000:00010000:0.0:1787574833.320011:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574833.320013:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320018:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba037 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320043:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba029 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 33 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320079:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 32 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.320086:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.320089:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787574833.320091:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409de00, rc 0) 00000100:00100000:0.0:1787574833.320155:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+32:18824:x1874407323767808:12345-192.168.202.40@tcp:101:stat.0 Request processed in 546us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.320163:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 48 00000100:00100000:2.0:1787574833.407683:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.407795:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323768064 00000100:00100000:0.0:1787574833.407805:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323768064 00000100:00100000:0.0:1787574833.407872:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:0.0:1787574833.407883:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+32:18834:x1874407323768064:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574833.407904:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574833.407925:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba045 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd6d expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574833.408052:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574833.408185:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba045 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd6d expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.408200:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574833.408203:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574833.408208:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba045 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd6d expref: 34 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.408283:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c400, rc 0) 00000100:00100000:0.0:1787574833.408362:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537342300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+33:18834:x1874407323768064:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 481us (690us total) trans 12884901910 rc 301/301 00000100:00100000:0.0:1787574833.408370:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 49 00000100:00100000:3.0:1787574833.414811:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574833.414924:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323768320 00000100:00100000:1.0:1787574833.414934:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323768320 00000100:00100000:1.0:1787574833.414992:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:1.0:1787574833.415003:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca510023850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+33:18834:x1874407323768320:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574833.415259:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca510023850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+34:18834:x1874407323768320:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 236us (438us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1787574833.415268:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 10 00000100:00100000:2.0:1787574833.491598:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.491718:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323768576 00000100:00100000:0.0:1787574833.491729:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323768576 00000100:00100000:0.0:1787574833.491798:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:0.0:1787574833.491809:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+34:18840:x1874407323768576:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574833.491834:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574833.491857:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba053 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd74 expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.491978:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.491996:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.492004:0:22712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 35 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.492014:0:22712:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.492075:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 35 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.492111:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 35 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574833.492125:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1874407346958080:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574833.492323:0:22712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.492332:0:22712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574833.492341:0:22712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1874407346958208:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574833.492366:0:22712:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca5203f3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787574833.496626:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1874407346958080:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574833.496636:0:22712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22712:1874407346958208:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574833.496657:0:22712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574833.497862:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574833.498298:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574833.498673:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323768704 00000100:00100000:1.0:1787574833.498683:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323768704 00010000:00010000:1.0:1787574833.498794:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 36 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574833.499002:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323768832 00000100:00100000:1.0:1787574833.499007:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323768832 00010000:00010000:1.0:1787574833.499022:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 37 pid: 22713 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574833.499233:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574833.499264:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+37:2405:x1874407323768704:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574833.499280:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574833.499287:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 37 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499303:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 37 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499343:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba03e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd66 expref: 37 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499360:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574833.499366:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499375:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499381:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574833.499440:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+36:2405:x1874407323768704:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 198us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574833.499448:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 17 00000100:00100000:1.0:1787574833.499501:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 18 00000100:00100000:1.0:1787574833.499509:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+35:2405:x1874407323768832:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787574833.499517:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787574833.499522:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499531:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499544:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddb9f81 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd2e expref: 35 pid: 22713 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499565:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574833.499569:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499577:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499584:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499609:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574833.499630:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537343800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+34:2405:x1874407323768832:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 122us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574833.499637:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 18 00010000:00010000:1.0:1787574833.499862:0:22712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.499870:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574833.499887:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1787574833.500015:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba053 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 35 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.500846:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 34 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.500862:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574833.500875:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787574833.500879:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ca00, rc 0) 00000100:00100000:1.0:1787574833.500929:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+34:18840:x1874407323768576:12345-192.168.202.40@tcp:101:bash.0 Request processed in 9120us (9340us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1787574833.500936:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 50 00000100:00100000:2.0:1787574833.504476:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.504554:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769088 00000100:00100000:0.0:1787574833.504565:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769088 00000100:00100000:0.0:1787574833.504629:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 51 00000100:00100000:0.0:1787574833.504640:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+34:18840:x1874407323769088:12345-192.168.202.40@tcp:36:bash.0 00010000:00010000:0.0:1787574833.504911:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.504928:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.504947:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574833.505228:0:22713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1787574833.505276:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a874dbab reply state 00000000d6b480f3 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.505290:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.505298:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.505300:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574833.505304:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574833.505405:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537342680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18840:x1874407323769088:12345-192.168.202.40@tcp:36:bash.0 Request processed in 765us (938us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1787574833.505413:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 51 00000020:00080000:0.0:1787574833.505418:0:22713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787574833.507663:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574833.507834:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769216 00000100:00100000:2.0:1787574833.507845:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769216 00000100:00100000:2.0:1787574833.507935:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574833.507946:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18840:x1874407323769216:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574833.508041:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574833.508103:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba06f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd7b expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574833.508160:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba06f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd7b expref: 38 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574833.508174:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba06f lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd7b expref: 38 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574833.508189:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:2.0:1787574833.508192:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787574833.508195:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f6a00, rc 0) 00000100:00100000:2.0:1787574833.508381:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18840:x1874407323769216:12345-192.168.202.40@tcp:101:bash.0 Request processed in 436us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574833.508389:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 52 00000100:00100000:2.0:1787574833.513568:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574833.513665:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769344 00000100:00100000:3.0:1787574833.513676:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769344 00000100:00100000:3.0:1787574833.513737:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1787574833.513747:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18840:x1874407323769344:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:3.0:1787574833.513768:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787574833.513788:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddba076 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd82 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574833.513884:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574833.513901:0:25756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 39 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574833.513911:0:25756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574833.513983:0:25756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 39 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574833.514010:0:25756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 39 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574833.514025:0:25756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53732c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25756:1874407346958336:192.168.202.40@tcp:104: 00000100:00100000:3.0:1787574833.514235:0:25756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca50315d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787574833.517412:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.517500:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769472 00000100:00100000:0.0:1787574833.517510:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769472 00010000:00010000:0.0:1787574833.517554:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 40 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574833.517590:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 19 00000100:00100000:0.0:1787574833.517598:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+40:2404:x1874407323769472:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787574833.517610:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574833.517615:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 5/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 40 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.517639:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 40 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.517657:0:22698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.517661:0:22698:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.517667:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.517673:0:22698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.517687:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574833.517739:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+40:2404:x1874407323769472:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 143us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.517744:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 19 00010000:00010000:1.0:1787574833.518286:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba05a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd74 expref: 39 pid: 22712 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574833.518306:0:25756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53732c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25756:1874407346958336:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574833.518327:0:25756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.518337:0:25756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.518343:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574833.518401:0:25756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787574833.518404:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574833.518421:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.518445:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19000/0xd18a1efeeddba076 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd82 expref: 39 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.518457:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd82 expref: 38 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.518472:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574833.518474:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574833.518475:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca509e19c00, rc 0) 00000100:00100000:1.0:1787574833.518522:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18840:x1874407323769344:12345-192.168.202.40@tcp:101:bash.0 Request processed in 4777us (4965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574833.518530:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 53 00000100:00100000:3.0:1787574833.522025:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.522168:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769728 00000100:00100000:0.0:1787574833.522178:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769728 00000100:00100000:0.0:1787574833.522319:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:0.0:1787574833.522329:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18840:x1874407323769728:12345-192.168.202.40@tcp:103:bash.0 00010000:00010000:0.0:1787574833.522346:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787574833.522375:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba06f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd7b expref: 38 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.522396:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba07d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd82 expref: 37 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.522426:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.522431:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787574833.522487:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+36:18840:x1874407323769728:12345-192.168.202.40@tcp:103:bash.0 Request processed in 159us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.522494:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 3 00000100:00100000:2.0:1787574833.529078:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574833.529187:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769856 00000100:00100000:1.0:1787574833.529195:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769856 00000100:00100000:1.0:1787574833.529283:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1787574833.529295:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+36:18840:x1874407323769856:12345-192.168.202.40@tcp:58:bash.0 00010000:00010000:1.0:1787574833.529402:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.529417:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574833.529425:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787574833.530834:0:22712:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787574833.530867:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1787574833.531018:0:22712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1787574833.531466:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+36:18840:x1874407323769856:12345-192.168.202.40@tcp:58:bash.0 Request processed in 2168us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574833.531478:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 54 00000100:00100000:1.0:1787574833.537376:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.537493:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323769984 00000100:00100000:0.0:1787574833.537503:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323769984 00000100:00100000:0.0:1787574833.537566:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 55 00000100:00100000:0.0:1787574833.537578:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+36:18840:x1874407323769984:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:0.0:1787574833.537599:0:22713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574833.537620:0:22713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd89 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537675:0:22713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537688:0:22713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 37 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537721:0:22713:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537736:0:22713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 37 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537751:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.537767:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787574833.537772:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 37 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.537781:0:22713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c200, rc 0) 00000100:00100000:0.0:1787574833.537843:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18840:x1874407323769984:12345-192.168.202.40@tcp:101:bash.0 Request processed in 267us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.537850:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 55 00010000:00010000:3.0:1787574833.598254:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787574833.969928:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787574833.969940:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787574833.969969:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787574833.969979:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787574833.970156:0:22745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca537342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22745:1874407346958464:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574833.970298:0:22745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574833.974078:0:22745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca537342a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22745:1874407346958464:192.168.202.40@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787574833.980504:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.980630:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323770112 00000100:00100000:0.0:1787574833.980641:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323770112 00000100:00100000:0.0:1787574833.980710:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:0.0:1787574833.980722:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18841:x1874407323770112:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574833.980756:0:22711:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574833.980956:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537342a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18841:x1874407323770112:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 235us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.980964:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 56 00000100:00100000:1.0:1787574833.984200:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.984414:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323770240 00000100:00100000:0.0:1787574833.984424:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323770240 00000100:00100000:0.0:1787574833.984487:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:0.0:1787574833.984498:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18841:x1874407323770240:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787574833.984632:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984649:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984665:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984706:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984714:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984721:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.984998:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985008:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985015:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574833.985082:0:22713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787574833.985087:0:22713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787574833.985102:0:22713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985114:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985121:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985128:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985473:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.985478:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985485:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985499:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca509d4dd00) 00010000:00010000:0.0:1787574833.985501:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574833.985506:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985513:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c800/0xd18a1efeeddba092 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985528:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985534:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985539:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985543:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ca00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.985546:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985551:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985571:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9ca534a4fe00) 00010000:00010000:0.0:1787574833.985573:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574833.985576:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985582:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba099 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985597:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985603:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985608:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985614:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.985616:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985622:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985628:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.985630:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574833.985633:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.985638:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0a0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574833.985751:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca535d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18841:x1874407323770240:12345-192.168.202.40@tcp:34:lhsmtool_posix.0 Request processed in 1251us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574833.985761:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 57 00000100:00100000:3.0:1787574833.992017:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574833.993197:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323770496 00000100:00100000:0.0:1787574833.993212:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323770496 00000100:00100000:0.0:1787574833.993299:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:0.0:1787574833.993311:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+37:18841:x1874407323770496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574833.993332:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574833.993354:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0a7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd90 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993461:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993478:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993490:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574833.993500:0:22711:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787574833.993634:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993642:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993649:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993672:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409de00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574833.993677:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993684:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993698:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574833.993701:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787574833.993706:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993712:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993754:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0a7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd90 expref: 39 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993765:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9ca509d4dd00) 00010000:00010000:0.0:1787574833.993767:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574833.993771:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0a7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd90 expref: 39 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574833.993782:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ce00, rc 0) 00000100:00100000:0.0:1787574833.994333:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18841:x1874407323770496:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 1022us (2323us total) trans 12884901915 rc 301/301 00000100:00100000:0.0:1787574833.994343:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 58 00000100:00100000:2.0:1787574834.006653:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.006749:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323770624 00000100:00100000:0.0:1787574834.006770:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323770624 00000100:00100000:0.0:1787574834.006831:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:0.0:1787574834.006841:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18841:x1874407323770624:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787574834.006890:0:22713:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787574834.007010:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537341f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18841:x1874407323770624:12345-192.168.202.40@tcp:53:lhsmtool_posix.0 Request processed in 170us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574834.007018:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 59 00000100:00100000:3.0:1787574834.010060:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.010093:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323770880 00000100:00100000:1.0:1787574834.010103:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323770880 00000100:00100000:1.0:1787574834.010184:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:1.0:1787574834.010195:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+38:18841:x1874407323770880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574834.010216:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574834.010237:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0bc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd97 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787574834.010731:0:25756:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =59 00000004:00080000:1.0:1787574834.010738:0:25756:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+59 in llog 00000004:00080000:1.0:1787574834.010753:0:25756:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1787574834.010910:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.010924:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.010935:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.010992:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0bc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd97 expref: 41 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.011011:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd97 expref: 40 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.011019:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca50a599d00) 00010000:00010000:1.0:1787574834.011022:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787574834.011026:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74400, rc 0) 00000100:00100000:1.0:1787574834.011111:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+40:18841:x1874407323770880:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 918us (1077us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1787574834.011119:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 60 00000100:00100000:3.0:1787574834.025358:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.025810:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323771136 00000100:00100000:0.0:1787574834.025821:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323771136 00000100:00100000:0.0:1787574834.025889:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:0.0:1787574834.025900:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+40:18841:x1874407323771136:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.025960:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574834.026000:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd97 expref: 40 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026021:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca50a599d00) 00010000:00010000:0.0:1787574834.026032:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574834.026065:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026080:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026089:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026138:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026166:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026174:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026221:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026228:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026234:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026289:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409ce00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.026294:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026302:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026311:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574834.026315:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.026319:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026325:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba0d1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026335:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026349:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026355:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026360:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409de00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.026363:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026369:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026378:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x7fb3ee (ffff9ca534a4fe00) 00010000:00010000:0.0:1787574834.026380:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.026382:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.026387:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0d8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7fb3ee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574834.026492:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+39:18841:x1874407323771136:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 583us (1134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787574834.026500:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 61 00000100:00100000:2.0:1787574834.030555:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.030666:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323771264 00000100:00100000:0.0:1787574834.030675:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323771264 00000100:00100000:0.0:1787574834.030727:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:0.0:1787574834.030737:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+39:18841:x1874407323771264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.030757:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574834.030786:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0df lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bd9e expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.030825:0:22712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba0e6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.030839:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba0e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.030851:0:22712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba0e6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.030960:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c400/0xd18a1efeeddba0df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd9e expref: 41 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.030991:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ca00/0xd18a1efeeddba0e6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd9e expref: 40 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.031001:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.031004:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787574834.031007:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ca00, rc 0) 00000100:00100000:0.0:1787574834.031078:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537341880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+40:18841:x1874407323771264:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 342us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574834.031085:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 62 00000100:00100000:3.0:1787574834.034980:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.042907:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323771520 00000100:00100000:0.0:1787574834.042924:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323771520 00000100:00100000:0.0:1787574834.043197:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:0.0:1787574834.043210:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+40:18841:x1874407323771520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.043310:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.043340:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.043352:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787574834.043593:0:22713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1787574834.043604:0:22713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773226362932ns, next at 774226360342ns, rc = 0 00000004:00010000:0.0:1787574834.043654:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b14260 reply state 000000008bb6a5dd transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.043668:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.043677:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.043680:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1787574834.043683:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574834.043809:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+42:18841:x1874407323771520:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 601us (8843us total) trans 12884901917 rc 0/0 00000100:00100000:0.0:1787574834.043817:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 63 00000100:00100000:3.0:1787574834.051752:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.051844:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323771648 00000100:00100000:1.0:1787574834.051855:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323771648 00000100:00100000:1.0:1787574834.051923:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1787574834.051934:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+42:18841:x1874407323771648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574834.051957:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574834.051979:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bda5 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.052037:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 43 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.052064:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 43 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.052086:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:1.0:1787574834.052090:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787574834.052093:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74a00, rc 0) 00000100:00100000:1.0:1787574834.052155:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+43:18841:x1874407323771648:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 223us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.052163:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 64 00000100:00100000:1.0:1787574834.056690:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.056870:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323771776 00000100:00100000:0.0:1787574834.056881:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323771776 00000100:00100000:0.0:1787574834.056955:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1787574834.056976:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2404:x1874407323771776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787574834.057233:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2404:x1874407323771776:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 267us (551us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1787574834.057272:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00080000:3.0:1787574834.057449:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787574834.059929:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.060144:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772032 00000100:00100000:0.0:1787574834.060169:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772032 00000100:00100000:0.0:1787574834.060233:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:0.0:1787574834.060283:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+43:18841:x1874407323772032:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787574834.060502:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+44:18841:x1874407323772032:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 221us (581us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1787574834.060510:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 11 00000100:00100000:2.0:1787574834.068312:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574834.068533:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772288 00000100:00100000:3.0:1787574834.068543:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772288 00000100:00100000:3.0:1787574834.068598:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:3.0:1787574834.068609:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+44:18841:x1874407323772288:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787574834.068741:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537341c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+44:18841:x1874407323772288:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 133us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.068749:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 65 00000100:00100000:2.0:1787574834.079357:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.083572:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772416 00000100:00100000:1.0:1787574834.083587:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772416 00000100:00100000:1.0:1787574834.083705:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:1.0:1787574834.083718:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+44:18841:x1874407323772416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787574834.083757:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574834.083780:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0fb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdac expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.083982:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.083998:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.084008:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787574834.084068:0:25756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787574834.084088:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.084114:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba0fb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdac expref: 46 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.084130:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdac expref: 45 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.084139:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:1.0:1787574834.084142:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787574834.084145:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be74800, rc 0) 00000100:00100000:1.0:1787574834.084218:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537343480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+45:18841:x1874407323772416:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 503us (4872us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.084226:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 66 00000100:00100000:2.0:1787574834.087481:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.088801:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772544 00000100:00100000:0.0:1787574834.088814:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772544 00000100:00100000:0.0:1787574834.088887:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:0.0:1787574834.088898:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+6:2405:x1874407323772544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.088916:0:24217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574834.088937:0:24217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdb3 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787574834.088973:0:24217:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8c3a31, blocks: 0x0 00010000:00010000:0.0:1787574834.088995:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=773s v=(0 0) 00010000:00010000:0.0:1787574834.088999:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574834.089009:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 7 pid: 24217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.089028:0:24217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 7 pid: 24217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.089042:0:24217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409c400, rc 0) 00000100:00100000:0.0:1787574834.089128:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537340e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2405:x1874407323772544:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 231us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574834.089154:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:2.0:1787574834.092622:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574834.092725:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772800 00000100:00100000:3.0:1787574834.092736:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772800 00000100:00100000:3.0:1787574834.092799:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1787574834.092810:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca537343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+45:18841:x1874407323772800:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787574834.092955:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca537343100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+45:18841:x1874407323772800:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.092963:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 67 00000100:00100000:3.0:1787574834.105923:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.106300:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323772928 00000100:00100000:0.0:1787574834.106312:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323772928 00000100:00100000:0.0:1787574834.106381:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:0.0:1787574834.106393:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+45:18841:x1874407323772928:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787574834.113289:0:22692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1787574834.113309:0:22692:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787574834.113394:0:22692:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:2.0:1787574834.114047:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787574834.114081:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346958592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787574834.114171:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787574834.114200:0:3620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114214:0:3620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114222:0:3620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114232:0:3620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d200 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574834.114236:0:3620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114275:0:3620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114293:0:3620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:3.0:1787574834.114295:0:3620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787574834.114301:0:3620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.114308:0:3620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d200/0xd18a1efeeddb9f1f lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114359:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114376:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114383:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114389:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.114393:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114400:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114411:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9ca509d4d000) 00010000:00010000:0.0:1787574834.114414:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.114417:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114423:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18400/0xd18a1efeeddb9ecb lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114442:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114456:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114462:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114467:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e18e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.114470:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114476:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114486:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:0.0:1787574834.114488:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.114491:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114497:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e18e00/0xd18a1efeeddb9ed2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114510:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114518:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114524:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114529:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409d400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.114539:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114546:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114555:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ca534a4fc00) 00010000:00010000:0.0:1787574834.114558:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.114560:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114567:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409d400/0xd18a1efeeddb9f7a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114582:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114588:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114594:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114599:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.114602:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114608:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114615:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574834.114617:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.114629:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114636:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19e00/0xd18a1efeeddb9fff lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114649:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114655:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114661:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114666:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c600 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.114669:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114675:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.114683:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574834.114685:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.114688:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115134:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c600/0xd18a1efeeddba022 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115148:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115154:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115165:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115169:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c000 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.115172:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115178:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115187:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:0.0:1787574834.115189:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787574834.115192:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115199:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c000/0xd18a1efeeddba068 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115209:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115216:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115221:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115226:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409de00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:0.0:1787574834.115229:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115285:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115295:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.115297:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787574834.115300:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.115306:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba0ed lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574834.115335:0:24814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346958592 00000100:00100000:0.0:1787574834.115344:0:24814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346958592 00000100:00100000:0.0:1787574834.115419:0:24814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787574834.115428:0:24814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca513d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346958592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787574834.115584:0:24814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787574834.115589:0:24814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787574834.115591:0:24814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787574834.115594:0:24814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787574833 -> 1787574833 00002000:00010000:0.0:1787574834.115596:0:24814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1787574834.115660:0:24814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca513d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1874407346958592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (1489us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1787574834.115667:0:24814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787574834.115911:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787574834.115951:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ca5373dd880/2, rc 0, transno 12884901892 00000100:00100000:2.0:1787574834.115958:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346958592:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787574834.116431:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+14:18841:x1874407323772928:12345-192.168.202.40@tcp:44:lhsmtool_posix.0 Request processed in 10037us (10516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574834.116439:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 68 00000100:00100000:2.0:1787574834.118722:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.119017:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773056 00000100:00100000:1.0:1787574834.119028:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773056 00000100:00100000:1.0:1787574834.119106:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:1.0:1787574834.119118:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2405:x1874407323773056:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787574834.119275:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2405:x1874407323773056:12345-192.168.202.40@tcp:16:lhsmtool_posix.0 Request processed in 159us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.119285:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574834.131962:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.132101:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773312 00000100:00100000:0.0:1787574834.132111:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773312 00000100:00100000:0.0:1787574834.132176:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574834.132187:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+14:18841:x1874407323773312:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.132290:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787574834.132339:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba102 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdac expref: 14 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.132359:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.132364:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787574834.132396:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba110 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.132412:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.132422:0:22713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787574834.132558:0:22713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000495d9fa7 reply state 0000000049a05509 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.132572:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409de00/0xd18a1efeeddba110 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.132578:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.132581:0:22713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787574834.132584:0:22713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787574834.132682:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+15:18841:x1874407323773312:12345-192.168.202.40@tcp:36:lhsmtool_posix.0 Request processed in 496us (732us total) trans 12884901919 rc 0/0 00000100:00100000:0.0:1787574834.132691:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:3.0:1787574834.142994:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574834.143147:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773440 00000100:00100000:2.0:1787574834.143160:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773440 00000100:00100000:2.0:1787574834.143228:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 24 00000100:00100000:2.0:1787574834.143285:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18841:x1874407323773440:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787574834.143305:0:24218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574834.143326:0:24218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdba expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.143364:0:24218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.143373:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574834.143384:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574834.143389:0:24218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.143423:0:24218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.143436:0:24218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574834.143450:0:24218:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24218:1874407346958720:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574834.143532:0:24218:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787574834.148679:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.148739:0:24218:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373df480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:24218:1874407346958720:192.168.202.40@tcp:104: 00010000:00010000:1.0:1787574834.148772:0:24218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.148795:0:24218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f6600, rc 0) 00000100:00100000:0.0:1787574834.148835:0:22698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773568 00000100:00100000:0.0:1787574834.148845:0:22698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773568 00000100:00100000:1.0:1787574834.148861:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+9:18841:x1874407323773440:12345-192.168.202.40@tcp:101:lhsmtool_posix.0 Request processed in 5622us (5875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.148870:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 24 00010000:00010000:0.0:1787574834.151336:0:22698:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574834.151473:0:22698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:0.0:1787574834.151493:0:22698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2405:x1874407323773568:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787574834.151607:0:22698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787574834.151634:0:22698:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.151649:0:22698:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.151675:0:22698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6be8273/0xd18a1efeeddba109 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdb3 expref: 8 pid: 24217 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.151707:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574834.151712:0:22698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574834.151719:0:22698:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.151738:0:22698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.151779:0:22698:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 7 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574834.151795:0:22698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22698:1874407346958848:192.168.202.40@tcp:105: 00000100:00100000:2.0:1787574834.151896:0:22698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787574834.157871:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.157874:0:22698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dd180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:22698:1874407346958848:192.168.202.40@tcp:105: 00010000:00010000:1.0:1787574834.157899:0:22698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787574834.157971:0:22698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2405:x1874407323773568:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 6488us (9303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.157983:0:22698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 20 00000100:00100000:3.0:1787574834.158587:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773696 00000100:00100000:3.0:1787574834.158598:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773696 00000100:00100000:3.0:1787574834.158641:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:3.0:1787574834.158649:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2405:x1874407323773696:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787574834.158804:0:24215:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787574834.158808:0:24215:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787574833 00002000:00010000:3.0:1787574834.158811:0:24215:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787574831 00002000:00010000:3.0:1787574834.158813:0:24215:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1787574833 -> 1787574833 00002000:00010000:3.0:1787574834.158816:0:24215:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1787574834.158862:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2405:x1874407323773696:12345-192.168.202.40@tcp:2:lhsmtool_posix.0 Request processed in 213us (1002us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787574834.158869:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574834.161758:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.161915:0:24217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773824 00000100:00100000:0.0:1787574834.161926:0:24217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773824 00000100:00100000:0.0:1787574834.161999:0:24217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:0.0:1787574834.162011:0:24217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2404:x1874407323773824:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787574834.162065:0:24217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.162089:0:24217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.162098:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787574834.162102:0:24217:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787574834.162107:0:24217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.162147:0:24217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.162164:0:24217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 8 pid: 24218 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787574834.162179:0:24217:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24217:1874407346958976:192.168.202.40@tcp:104: 00000100:00100000:0.0:1787574834.162341:0:24217:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787574834.167395:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.167438:0:24217:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24217:1874407346958976:192.168.202.40@tcp:104: 00010000:00010000:0.0:1787574834.169293:0:24217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.169404:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323773952 00000100:00100000:3.0:1787574834.169414:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323773952 00010000:00010000:3.0:1787574834.169455:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 9 pid: 24218 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.169500:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 21 00000100:00100000:3.0:1787574834.169510:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+9:2405:x1874407323773952:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574834.169524:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574834.169545:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 9 pid: 24218 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.169558:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 9 pid: 24218 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.169599:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023a3b386/0xd18a1efeeddba117 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdba expref: 9 pid: 24218 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.169615:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574834.169618:0:22699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787574834.169623:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.169632:0:22699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.169649:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574834.169716:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2405:x1874407323773952:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 207us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.169723:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 21 00010000:00010000:1.0:1787574834.171521:0:24217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171555:0:24217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171583:0:24217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171592:0:24217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171601:0:24217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171607:0:24217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca40409c600 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:1.0:1787574834.171612:0:24217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171621:0:24217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171638:0:24217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.171646:0:24217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba7aeae3/0xd18a1efeeddba11e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574834.171872:0:24217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+7:2404:x1874407323773824:12345-192.168.202.40@tcp:1:lhsmtool_posix.0 Request processed in 9848us (10111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.171883:0:24217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:1.0:1787574834.175766:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574834.175854:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774208 00000100:00100000:2.0:1787574834.176065:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774208 00000100:00100000:2.0:1787574834.176188:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:2.0:1787574834.176200:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+15:18841:x1874407323774208:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787574834.176348:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.176367:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 15 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.176376:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.176414:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 15 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.176447:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 15 pid: 22711 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574834.176463:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373df100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959104:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574834.176539:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787574834.178881:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373df100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959104:192.168.202.40@tcp:104: 00010000:00010000:3.0:1787574834.178912:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574834.180693:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:3.0:1787574834.180898:0:25050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774336 00000100:00100000:3.0:1787574834.180907:0:25050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774336 00010000:00010000:3.0:1787574834.180949:0:25050:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 16 pid: 22711 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.181002:0:25050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 22 00000100:00100000:3.0:1787574834.181013:0:25050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+16:2404:x1874407323774336:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574834.181064:0:25050:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574834.181072:0:25050:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 16 pid: 22711 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181092:0:25050:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 16 pid: 22711 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181114:0:25050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409da00/0xd18a1efeeddb9ff8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd58 expref: 16 pid: 22711 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181132:0:25050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574834.181138:0:25050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 15 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181148:0:25050:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181156:0:25050:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181163:0:25050:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.181196:0:25050:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574834.181275:0:25050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+15:2404:x1874407323774336:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 263us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.181282:0:25050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 22 00010000:00010000:2.0:1787574834.182665:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182678:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182909:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182923:0:22711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 15 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182931:0:22711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182980:0:22711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 15 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.182994:0:22711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 15 pid: 25756 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787574834.183007:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959232:192.168.202.40@tcp:104: 00000100:00100000:2.0:1787574834.183124:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca40231e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787574834.190011:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574834.190202:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959232:192.168.202.40@tcp:104: 00010000:00010000:2.0:1787574834.190231:0:22711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.190416:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774464 00000100:00100000:3.0:1787574834.190424:0:22699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774464 00010000:00010000:3.0:1787574834.190483:0:22699:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 16 pid: 25756 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.190527:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 23 00000100:00100000:3.0:1787574834.190537:0:22699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+16:2405:x1874407323774464:12345-192.168.202.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787574834.190553:0:22699:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787574834.190561:0:22699:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 16 pid: 25756 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190574:0:22699:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 16 pid: 25756 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190596:0:22699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba0f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bda5 expref: 16 pid: 25756 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190611:0:22699:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:3.0:1787574834.190616:0:22699:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190625:0:22699:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190632:0:22699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.190656:0:22699:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787574834.190724:0:22699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca502c56850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+15:2405:x1874407323774464:12345-192.168.202.40@tcp:103:ldlm_bl.0 Request processed in 188us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.190732:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 23 00010000:00010000:0.0:1787574834.190837:0:22711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.190846:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787574834.190984:0:22711:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1787574834.191121:0:22711:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1787574834.191161:0:22711:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1787574834.191290:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22711:1874407346959360:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787574834.191394:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574834.191428:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca4037bfc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787574834.191852:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346959360 00000100:00100000:3.0:1787574834.191866:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346959360 00000100:00100000:3.0:1787574834.191904:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574834.191912:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22711:x1874407346959360:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787574834.192014:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22711:x1874407346959360:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.192021:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787574834.192070:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53bf8f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22711:1874407346959360:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1787574834.192269:0:22711:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1787574834.192325:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53732ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22711:1874407346959488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787574834.192357:0:22711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574834.192380:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346959488 00000100:00100000:3.0:1787574834.192384:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346959488 00000100:00100000:3.0:1787574834.192421:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574834.192428:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22711:x1874407346959488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787574834.192522:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22711:x1874407346959488:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (164us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787574834.192529:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787574834.192548:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca518a18480 going to sleep for 11 seconds 00000100:00100000:3.0:1787574834.192564:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53732ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22711:1874407346959488:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1787574834.192596:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192606:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192612:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192624:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6e00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574834.192629:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192636:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192650:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:3.0:1787574834.192652:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574834.192656:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192662:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6e00/0xd18a1efeeddba12c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192690:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192709:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192714:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192719:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be75a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574834.192721:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192728:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192746:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574834.192748:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787574834.192755:0:22711:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 18 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192766:0:22711:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 18 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192774:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 18 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.192797:0:22711:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409c200/0xd18a1efeeddba08b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bd89 expref: 18 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.192807:0:22711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53732ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959616:192.168.202.40@tcp:105: 00000100:00100000:3.0:1787574834.192857:0:22711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ca52059a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787574834.198520:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.198602:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774592 00000100:00100000:0.0:1787574834.198611:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774592 00000100:00100000:0.0:1787574834.198679:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:0.0:1787574834.198693:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18840:x1874407323774592:12345-192.168.202.40@tcp:49:bash.0 00000100:00100000:0.0:1787574834.198841:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18840:x1874407323774592:12345-192.168.202.40@tcp:49:bash.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574834.198849:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 12 00000100:00100000:3.0:1787574834.198991:0:22711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53732ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22711:1874407346959616:192.168.202.40@tcp:105: 00010000:00010000:3.0:1787574834.199018:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199028:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba084 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199068:0:22711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199083:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199108:0:22711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199119:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199126:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199133:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199140:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca509e19c00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574834.199144:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199151:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199162:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574834.199165:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787574834.199169:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199176:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca509e19c00/0xd18a1efeeddba133 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199188:0:22711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199194:0:22711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199207:0:22711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199212:0:22711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca5372f6a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:3.0:1787574834.199216:0:22711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199223:0:22711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199231:0:22711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:3.0:1787574834.199234:0:22711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787574834.199237:0:22711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787574834.199280:0:22711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca5372f6a00/0xd18a1efeeddba125 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787574834.199413:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+18:18841:x1874407323774208:12345-192.168.202.40@tcp:57:lhsmtool_posix.0 Request processed in 23215us (23655us total) trans 12884901924 rc 0/0 00000100:00100000:3.0:1787574834.199422:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000020:00080000:3.0:1787574834.199425:0:22711:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787574834.200430:0:22745:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787574834.200437:0:22745:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787574834.200455:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1787574834.200468:0:22745:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787574834.202979:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574834.203137:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774720 00000100:00100000:2.0:1787574834.203148:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774720 00000100:00100000:2.0:1787574834.203214:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1787574834.203224:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+7:18840:x1874407323774720:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:2.0:1787574834.203277:0:24218:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787574834.203303:0:24218:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddba13a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdc1 expref: -99 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787574834.203331:0:24218:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a8c3a31, atime: 0x6a8c3a2f, ctime: 0x6a8c3a31, blocks: 0x0 00010000:00010000:2.0:1787574834.203353:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1787574834.203359:0:24218:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787574834.203370:0:24218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddba13a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdc1 expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.203386:0:24218:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7ac6d93/0xd18a1efeeddba13a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdc1 expref: 8 pid: 24218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787574834.203400:0:24218:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca5372f7e00, rc 0) 00000100:00100000:2.0:1787574834.203465:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+8:18840:x1874407323774720:12345-192.168.202.40@tcp:101:bash.0 Request processed in 242us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574834.203489:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:2.0:1787574834.207968:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574834.208086:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.208747:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323775104 00000100:00100000:1.0:1787574834.208759:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323775104 00000100:00100000:1.0:1787574834.208836:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:1.0:1787574834.208846:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+18:18840:x1874407323775104:12345-192.168.202.40@tcp:101:bash.0 00010000:00010000:1.0:1787574834.208879:0:25756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787574834.208901:0:25756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba141 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdc8 expref: -99 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.208938:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba148 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.208952:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba148 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.208975:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba148 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.209117:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba141 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdc8 expref: 20 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.209151:0:25756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be75a00/0xd18a1efeeddba148 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdc8 expref: 19 pid: 25756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.209160:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574834.209163:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787574834.209166:0:25756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca53be75a00, rc 0) 00000100:00100000:1.0:1787574834.209236:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18840:x1874407323775104:12345-192.168.202.40@tcp:101:bash.0 Request processed in 391us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.209277:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1787574834.210424:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323774976 00000100:00100000:0.0:1787574834.210437:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323774976 00000100:00100000:1.0:1787574834.212265:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 13 00000100:00100000:1.0:1787574834.212279:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+19:18841:x1874407323774976:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787574834.212557:0:22714:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787574834.212591:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1787574834.212624:0:22714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212642:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212653:0:22714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212661:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212667:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212689:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.212715:0:22714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787574834.212819:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18841:x1874407323774976:12345-192.168.202.40@tcp:35:lhsmtool_posix.0 Request processed in 542us (4865us total) trans 12884901926 rc 0/0 00000100:00100000:1.0:1787574834.212827:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 13 00000020:00080000:1.0:1787574834.212832:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787574834.212939:0:22700:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787574834.212947:0:22700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.212955:0:22700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc0caa230) 00010000:00010000:0.0:1787574834.212959:0:22700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.212968:0:22700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.212981:0:22700:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9ca534a4fb00) 00010000:00010000:0.0:1787574834.212984:0:22700:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787574834.212988:0:22700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.212994:0:22700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba14f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22714 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.213007:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574834.213009:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787574834.213010:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787574834.215304:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.215412:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323775360 00000100:00100000:1.0:1787574834.215423:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323775360 00000100:00100000:1.0:1787574834.215483:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 14 00000100:00100000:1.0:1787574834.215493:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+21:18840:x1874407323775360:12345-192.168.202.40@tcp:35:bash.0 00000001:00080000:1.0:1787574834.215789:0:22714:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:1.0:1787574834.216056:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+23:18840:x1874407323775360:12345-192.168.202.40@tcp:35:bash.0 Request processed in 554us (756us total) trans 12884901928 rc 0/0 00000100:00100000:1.0:1787574834.216065:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 14 00000020:00080000:1.0:1787574834.216069:0:22714:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787574834.370443:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:0.0:1787574834.371157:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323775616 00000100:00100000:0.0:1787574834.371168:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323775616 00000100:00100000:0.0:1787574834.371294:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1787574834.371307:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+23:18851:x1874407323775616:12345-192.168.202.40@tcp:101:lfs.0 00010000:00010000:0.0:1787574834.371339:0:22712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787574834.371361:0:22712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xee3815b9b5a9bdcf expref: -99 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787574834.371502:0:22712:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787574834.371612:0:22712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba156 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdcf expref: 25 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.371627:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ca50a599000) 00010000:00010000:0.0:1787574834.371630:0:22712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787574834.371635:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca40409ce00/0xd18a1efeeddba156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.40@tcp remote: 0xee3815b9b5a9bdcf expref: 25 pid: 22712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787574834.371649:0:22712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ca40409ce00, rc 0) 00000100:00100000:0.0:1787574834.371729:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+24:18851:x1874407323775616:12345-192.168.202.40@tcp:101:lfs.0 Request processed in 424us (1297us total) trans 12884901929 rc 301/301 00000100:00100000:0.0:1787574834.371737:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:2.0:1787574834.378496:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.378591:0:25756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323775744 00000100:00100000:1.0:1787574834.378601:0:25756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323775744 00000100:00100000:1.0:1787574834.378662:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:1.0:1787574834.378672:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+24:18851:x1874407323775744:12345-192.168.202.40@tcp:34:lfs.0 00010000:00010000:1.0:1787574834.378761:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378778:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378789:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378819:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378827:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378834:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378912:0:25756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378921:0:25756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.378929:0:25756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787574834.379408:0:25756:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379423:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379430:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379436:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379442:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74400 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574834.379447:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379465:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379480:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9ca509d4df00) 00010000:00010000:1.0:1787574834.379483:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574834.379488:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379494:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74400/0xd18a1efeeddba164 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379507:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379513:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379519:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379524:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74800 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574834.379527:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379533:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379539:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9ca534b48e00) 00010000:00010000:1.0:1787574834.379541:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574834.379544:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379559:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74800/0xd18a1efeeddba16b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379576:0:25756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379582:0:25756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379588:0:25756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379592:0:25756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ca53be74a00 already unused, calling callback (ffffffffc18d74f0) 00010000:00010000:1.0:1787574834.379595:0:25756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379600:0:25756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379608:0:25756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9ca534a4f700) 00010000:00010000:1.0:1787574834.379610:0:25756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787574834.379613:0:25756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787574834.379619:0:25756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ca53be74a00/0xd18a1efeeddba172 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 25756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787574834.379750:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:67ff1a69-1def-49cc-a130-05878a5b0e46+24:18851:x1874407323775744:12345-192.168.202.40@tcp:34:lfs.0 Request processed in 1078us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574834.379758:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 73 00000100:00100000:2.0:1787574834.389476:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:1.0:1787574834.389571:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776000 00000100:00100000:1.0:1787574834.389582:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776000 00000100:00100000:1.0:1787574834.389645:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 15 00000100:00100000:1.0:1787574834.389654:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+24:18851:x1874407323776000:12345-192.168.202.40@tcp:35:lfs.0 00000100:00100000:1.0:1787574834.389897:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+25:18851:x1874407323776000:12345-192.168.202.40@tcp:35:lfs.0 Request processed in 243us (430us total) trans 12884901930 rc 0/0 00000100:00100000:1.0:1787574834.389906:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 15 00010000:00010000:3.0:1787574834.609458:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574834.929838:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574834.929864:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346959744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787574834.929950:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574834.930188:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346959744 00000100:00100000:3.0:1787574834.930199:0:24220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346959744 00000100:00100000:3.0:1787574834.930304:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787574834.930315:0:24220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346959744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1787574834.930345:0:24220:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1787574834.930406:0:24220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346959744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574834.930427:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574834.930522:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346959744:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787574834.934279:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787574835.633530:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787574835.953582:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346959872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787574835.953656:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574835.953773:0:23452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346959872 00000100:00100000:0.0:1787574835.953793:0:23452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346959872 00000100:00100000:0.0:1787574835.953846:0:23452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787574835.953857:0:23452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346959872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787574835.953891:0:23452:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:0.0:1787574835.953960:0:23452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346959872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574835.953967:0:23452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787574835.954270:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346959872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787574835.954491:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787574835.954501:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca53732e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346960000:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787574835.954536:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574835.954615:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960000 00000100:00100000:3.0:1787574835.954620:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960000 00000100:00100000:3.0:1787574835.954657:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574835.954664:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca5373dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346960000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787574835.954686:0:22716:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787574835.954749:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca5373dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346960000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574835.954755:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787574835.954795:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca53732e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346960000:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1787574836.245366:0:25794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1787574836.659639:0:22701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787574836.977664:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346960128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787574836.977751:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574836.977838:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787574836.977845:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346960256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574836.977879:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787574836.977911:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960128 00000100:00100000:0.0:1787574836.977918:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960128 00000100:00100000:0.0:1787574836.977959:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960256 00000100:00100000:0.0:1787574836.977962:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960256 00000100:00100000:0.0:1787574836.977976:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574836.977987:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346960128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787574836.978016:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:0.0:1787574836.978071:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1874407346960128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574836.978078:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787574836.978095:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574836.978102:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346960256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787574836.978115:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1787574836.978138:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53bf8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1874407346960256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574836.978144:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787574836.978177:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346960256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787574836.978188:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1874407346960128:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1787574836.978445:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787574836.978449:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787574836.978685:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346960384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978718:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.978751:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346960896:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978785:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.978802:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca536c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346961408:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978831:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.978849:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1787574836.978868:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346960512:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978889:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.978903:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346961024:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978919:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.978930:0:3634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca536c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346961536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.978947:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979160:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346960768:0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979189:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979207:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca536c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346961280:0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979223:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979253:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1787574836.979259:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca5373dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346960640:0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979276:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979288:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca536c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346961152:0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979310:0:3637:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca536c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346961664:0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787574836.979364:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960896 00000100:00100000:3.0:1787574836.979368:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960896 00000100:00100000:3.0:1787574836.979396:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960512 00000100:00100000:3.0:1787574836.979399:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960512 00000100:00100000:3.0:1787574836.979410:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574836.979416:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346960896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979458:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346960896:12345-0@lo:400:kworker.0 Request processed in 41us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574836.979464:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787574836.979478:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574836.979484:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346960512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979510:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3634:x1874407346960512:12345-0@lo:400:kworker.0 Request processed in 27us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574836.979516:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574836.979536:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961408 00000100:00100000:3.0:1787574836.979539:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961408 00000100:00100000:3.0:1787574836.979562:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961536 00000100:00100000:3.0:1787574836.979564:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961536 00000100:00100000:3.0:1787574836.979575:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960768 00000100:00100000:3.0:1787574836.979577:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960768 00000100:00100000:3.0:1787574836.979586:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961280 00000100:00100000:3.0:1787574836.979589:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961280 00000100:00100000:3.0:1787574836.979599:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961152 00000100:00100000:3.0:1787574836.979602:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961152 00000100:00100000:3.0:1787574836.979612:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961664 00000100:00100000:3.0:1787574836.979614:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961664 00000100:00100000:3.0:1787574836.979626:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574836.979631:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346961408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979670:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1874407346961408:12345-0@lo:400:kworker.0 Request processed in 39us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574836.979677:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787574836.979690:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574836.979695:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346961536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979718:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1874407346961536:12345-0@lo:400:kworker.0 Request processed in 24us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574836.979724:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787574836.979734:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787574836.979740:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346960768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.979830:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1874407346960768:12345-0@lo:400:kworker.0 Request processed in 90us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574836.979837:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787574836.979968:0:22707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960384 00000100:00100000:2.0:1787574836.979973:0:22707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960384 00000100:00100000:2.0:1787574836.980039:0:22707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787574836.980047:0:22707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346960384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574836.980082:0:22707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503092450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f82b38c-81e1-4088-8af8-2f43485ff140+24:3634:x1874407346960384:12345-0@lo:400:kworker.0 Request processed in 37us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574836.980088:0:22707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:2.0:1787574836.980115:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787574836.980118:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787574836.980162:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787574836.980172:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787574836.980203:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1874407346961280:12345-0@lo:400:kworker.0 Request processed in 34us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574836.980345:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961024 00000100:00100000:1.0:1787574836.980349:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961024 00000100:00100000:1.0:1787574836.980390:0:25205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346960640 00000100:00100000:1.0:1787574836.980394:0:25205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346960640 00000100:00100000:1.0:1787574836.980415:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574836.980421:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca52e74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346961024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980455:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca52e74f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3634:x1874407346961024:12345-0@lo:400:kworker.0 Request processed in 34us (1535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574836.980461:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787574836.980475:0:25205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787574836.980481:0:25205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346960640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980508:0:25205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3637:x1874407346960640:12345-0@lo:400:kworker.0 Request processed in 29us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574836.980514:0:25205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787574836.980535:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787574836.980537:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787574836.980556:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787574836.980567:0:3636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ca52e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346961792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574836.980598:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787574836.980640:0:24219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407346961792 00000100:00100000:1.0:1787574836.980643:0:24219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407346961792 00000100:00100000:1.0:1787574836.980667:0:24219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574836.980673:0:24219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346961792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787574836.980687:0:24219:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1787574836.980719:0:24219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53be5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1874407346961792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787574836.980724:0:24219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787574836.980762:0:3636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca52e74dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1874407346961792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787574836.980815:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1874407346960640:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980836:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3637:1874407346960768:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980846:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca536c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3637:1874407346961280:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980896:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3634:1874407346960512:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980907:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346961024:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980915:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca536c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3634:1874407346961536:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980923:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4f82b38c-81e1-4088-8af8-2f43485ff140:3634:1874407346960384:0@lo:400:kworker.0 00000100:00100000:1.0:1787574836.980932:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca5373dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1874407346960896:0@lo:400:kworker.0 00010000:00080000:1.0:1787574836.980944:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca536c96680 x1874407346961408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787574836.980954:0:3634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca536c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3634:1874407346961408:0@lo:400:kworker.0 00000100:00100000:2.0:1787574836.985572:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574836.985606:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346961152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574836.985723:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1874407346961152:12345-0@lo:400:kworker.0 Request processed in 137us (6418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574836.985746:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787574836.985779:0:25756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787574836.985788:0:25756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca53732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346961664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787574836.985823:0:25756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca53732c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1874407346961664:12345-0@lo:400:kworker.0 Request processed in 38us (6482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574836.985829:0:25756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787574836.986069:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787574836.986162:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca536c94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3637:1874407346961152:0@lo:400:kworker.0 00010000:00080000:2.0:1787574836.986178:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9ca536c94700 x1874407346961664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787574852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787574836.986189:0:3637:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ca536c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3637:1874407346961664:0@lo:400:kworker.0 00000100:00100000:2.0:1787574837.005526:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005573:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005609:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005638:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005658:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005682:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005697:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005715:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005735:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.005764:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776640 00000100:00100000:2.0:1787574837.005783:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776640 00000100:00100000:2.0:1787574837.005837:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323777152 00000100:00100000:2.0:1787574837.005840:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323777152 00000100:00100000:2.0:1787574837.005870:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776512 00000100:00100000:2.0:1787574837.005873:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776512 00000100:00100000:2.0:1787574837.005886:0:24218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323777024 00000100:00100000:2.0:1787574837.005902:0:24218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323777024 00000100:00100000:2.0:1787574837.005923:0:24218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:0.0:1787574837.005974:0:22705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776128 00000100:00100000:0.0:1787574837.005979:0:22705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776128 00000100:00100000:0.0:1787574837.006009:0:22705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1787574837.006017:0:22705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2402:x1874407323776128:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574837.006126:0:22705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca503093c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88f0bcd3-417f-4999-8db3-d6d8197f2f2b+13:2402:x1874407323776128:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 109us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574837.006134:0:22705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 168 00000100:00100000:0.0:1787574837.006289:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776384 00000100:00100000:0.0:1787574837.006294:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776384 00000100:00100000:0.0:1787574837.006315:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776896 00000100:00100000:0.0:1787574837.006318:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776896 00000100:00100000:0.0:1787574837.006330:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776256 00000100:00100000:0.0:1787574837.006332:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776256 00000100:00100000:0.0:1787574837.006344:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323776768 00000100:00100000:0.0:1787574837.006346:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323776768 00000100:00100000:0.0:1787574837.006359:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574837.006365:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323776384:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574837.006405:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323776384:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 39us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574837.006412:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 69 00000100:00100000:0.0:1787574837.006424:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1787574837.006430:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323776896:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574837.006456:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323776896:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574837.006463:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 70 00000100:00100000:0.0:1787574837.006474:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1787574837.006480:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+25:2402:x1874407323776256:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574837.006505:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:67ff1a69-1def-49cc-a130-05878a5b0e46+25:2402:x1874407323776256:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574837.006522:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 71 00000100:00100000:0.0:1787574837.006535:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00100000:0.0:1787574837.006541:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2402:x1874407323776768:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:0.0:1787574837.006566:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:25d8d94f-1ce9-4a7b-bce1-12ff074de286+6:2402:x1874407323776768:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 26us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787574837.006572:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 72 00000100:00080000:1.0:1787574837.006745:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787574837.006750:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787574837.006753:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787574837.006755:0:22708:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787574837.006810:0:24218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323776640:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:2.0:1787574837.006848:0:24218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:67ff1a69-1def-49cc-a130-05878a5b0e46+5:2402:x1874407323776640:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 916us (1238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574837.009551:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1787574837.009575:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323777152:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574837.009705:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323777152:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 141us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574837.009714:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 26 00000100:00100000:3.0:1787574837.009859:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574837.009885:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2402:x1874407323776512:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574837.009914:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2402:x1874407323776512:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 31us (4215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574837.009920:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 27 00000100:00100000:3.0:1787574837.009931:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:3.0:1787574837.010056:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323777024:12345-192.168.202.40@tcp:400:kworker.0 00000100:00100000:3.0:1787574837.010082:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:25d8d94f-1ce9-4a7b-bce1-12ff074de286+5:2402:x1874407323777024:12345-192.168.202.40@tcp:400:kworker.0 Request processed in 145us (4347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787574837.010088:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1787574837.030142:0:24218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 25 00000100:00100000:2.0:1787574837.518361:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.518480:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.40@tcp (source: 12345-192.168.202.40@tcp) 00000100:00100000:2.0:1787574837.518524:0:24215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323777408 00000100:00100000:2.0:1787574837.518537:0:24215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323777408 00000100:00100000:2.0:1787574837.518608:0:24215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:2.0:1787574837.518620:0:24215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2402:x1874407323777408:12345-192.168.202.40@tcp:16:kworker.0 00000100:00100000:2.0:1787574837.518797:0:24215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2402:x1874407323777408:12345-192.168.202.40@tcp:16:kworker.0 Request processed in 179us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787574837.518805:0:24215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 28 00000100:00100000:1.0:1787574837.519115:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874407323777280 00000100:00100000:1.0:1787574837.519121:0:24221:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874407323777280 00002000:00100000:1.0:1787574837.519154:0:24221:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9ca536c95180 x1874407323777280/t0(0) o4->67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp:608/0 lens 504/0 e 0 to 0 dl 1787574848 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787574837.519166:0:24221:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca536c95180 with x1874407323777280 ext(0->8) 00002000:00010000:1.0:1787574837.519173:0:24221:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca536c95180 00000100:00100000:1.0:1787574837.519205:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.40@tcp, seq: 0 00000100:00100000:1.0:1787574837.519213:0:24221:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ca536c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+8:2403:x1874407323777280:12345-192.168.202.40@tcp:4:bash.0 00000100:00100000:1.0:1787574837.524061:0:24221:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ca536c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:67ff1a69-1def-49cc-a130-05878a5b0e46+10:2403:x1874407323777280:12345-192.168.202.40@tcp:4:bash.0 Request processed in 4838us (5704us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787574837.524077:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.40@tcp, seq: 0 00002000:00100000:1.0:1787574837.524100:0:24221:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff9ca536c95180 x1874407323777280/t12884901895(0) o4->67ff1a69-1def-49cc-a130-05878a5b0e46@192.168.202.40@tcp:608/0 lens 504/448 e 0 to 0 dl 1787574848 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1787574837.524112:0:24221:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ca536c95180 with x1874407323777280 ext(0->8) 00002000:00010000:1.0:1787574837.524119:0:24221:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9ca536c95180 00010000:00010000:2.0:1787574837.684442:0:22700:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14666 lines, 14666 kept, 0 dropped, 0 bad.