00010000:00010000:1.0F:1787190624.018597:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0F:1787190625.043694:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190625.431602:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190625.431625:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f166533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695800320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787190625.431688:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190625.437606:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800320 00000100:00100000:0.0:1787190625.437623:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800320 00000100:00100000:0.0:1787190625.437704:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787190625.437727:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695800320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787190625.437762:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190625.437837:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695800320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (6149us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190625.437844:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1787190625.438132:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190625.438457:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f166533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695800320:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1787190625.949282:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1787190625.949324:0:17178:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99f158868600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1787190625.949331:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99f165ea0c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99f158868d80 00000020:00080000:1.0:1787190625.949334:0:17178:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99f165ea0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99f1700bba00 00010000:00010000:0.0:1787190625.949350:0:3637:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190625.949364:0:3637:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787190625.949366:0:17238:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00010000:00010000:0.0:1787190625.949377:0:3637:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190625.949384:0:3637:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5a00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:0.0:1787190625.949389:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190625.949397:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190625.949417:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99f17c2c0100) 00010000:00010000:0.0:1787190625.949421:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190625.949427:0:3637:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190625.949434:0:3637:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5a00/0xdedcc04674eb48e3 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19230 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787190625.949452:0:17238:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787190626.071707:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190626.451785:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190626.451862:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190626.451964:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190626.451970:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695800576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190626.451994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190626.452026:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800448 00000100:00100000:0.0:1787190626.452033:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800448 00000100:00100000:0.0:1787190626.452083:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800576 00000100:00100000:0.0:1787190626.452086:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800576 00000100:00100000:0.0:1787190626.452106:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787190626.452115:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695800448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190626.452138:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190626.452180:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695800448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190626.452187:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787190626.452203:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787190626.452209:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695800576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787190626.452228:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787190626.452253:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695800576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190626.452258:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787190626.452276:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190626.452280:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190626.452330:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695800576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190626.452342:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695800448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190626.452686:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695800704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190626.452730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190626.452763:0:19861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800704 00000100:00100000:0.0:1787190626.452768:0:19861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800704 00000100:00100000:0.0:1787190626.452793:0:19861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190626.452800:0:19861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695800704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787190626.452823:0:19861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787190626.452856:0:19861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695800704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190626.452862:0:19861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787190626.452891:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695800704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0F:1787190626.453386:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190626.453416:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695800832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787190626.453445:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190626.453477:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800832 00000100:00100000:3.0:1787190626.453481:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800832 00000100:00100000:3.0:1787190626.453516:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787190626.453523:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695800832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190626.453541:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190626.453574:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695800832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190626.453580:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787190626.453612:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695800832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0F:1787190626.454017:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695800960:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454078:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695801472:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454102:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454117:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695801984:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454152:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787190626.454157:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695801088:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454194:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695801600:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454212:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454236:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695801216:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454258:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454271:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695801728:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454311:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454322:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190626.454327:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695801344:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.454362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.454379:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695801856:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.455558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190626.455602:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695800960 00000100:00100000:2.0:1787190626.455608:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695800960 00000100:00100000:2.0:1787190626.455673:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787190626.455682:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1587b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3653:x1874004695800960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.455794:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1587b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3653:x1874004695800960:12345-0@lo:400:kworker.0 Request processed in 113us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.455809:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787190626.455840:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801472 00000100:00100000:2.0:1787190626.455844:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801472 00000100:00100000:2.0:1787190626.455862:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801984 00000100:00100000:2.0:1787190626.455865:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801984 00000100:00100000:2.0:1787190626.455890:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801600 00000100:00100000:2.0:1787190626.455893:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801600 00000100:00100000:2.0:1787190626.455905:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801216 00000100:00100000:2.0:1787190626.455907:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801216 00000100:00100000:2.0:1787190626.455916:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801728 00000100:00100000:2.0:1787190626.455918:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801728 00000100:00100000:2.0:1787190626.455929:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801856 00000100:00100000:2.0:1787190626.455932:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801856 00000100:00100000:2.0:1787190626.455945:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787190626.455951:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695801472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.455984:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695801472:12345-0@lo:400:kworker.0 Request processed in 33us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.455991:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787190626.456003:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787190626.456008:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695801984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456033:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695801984:12345-0@lo:400:kworker.0 Request processed in 26us (1897us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456039:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787190626.456050:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787190626.456055:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695801600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456080:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695801600:12345-0@lo:400:kworker.0 Request processed in 25us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456085:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787190626.456103:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787190626.456109:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695801216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456142:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695801216:12345-0@lo:400:kworker.0 Request processed in 33us (1883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456149:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787190626.456160:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787190626.456165:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695801728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456189:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695801728:12345-0@lo:400:kworker.0 Request processed in 25us (1878us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456195:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787190626.456205:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787190626.456211:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695801856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456237:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695801856:12345-0@lo:400:kworker.0 Request processed in 27us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456243:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787190626.456264:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801088 00000100:00100000:2.0:1787190626.456268:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801088 00000100:00100000:2.0:1787190626.456312:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695801344 00000100:00100000:2.0:1787190626.456315:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695801344 00000100:00100000:2.0:1787190626.456334:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787190626.456341:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695801088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.456369:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695801088:12345-0@lo:400:kworker.0 Request processed in 29us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.456375:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787190626.456386:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787190626.456392:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695801344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461639:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695801344:12345-0@lo:400:kworker.0 Request processed in 5243us (7272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190626.461651:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787190626.461810:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695801088:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461824:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695801600:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461835:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695800960:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461847:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695801472:0@lo:400:kworker.0 00010000:00080000:2.0:1787190626.461861:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17d99fb80 x1874004695801984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190626.461871:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695801984:0@lo:400:kworker.0 00000100:00080000:2.0:1787190626.461904:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190626.461910:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190626.461913:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787190626.461932:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695801344:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461944:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695801856:0@lo:400:kworker.0 00000100:00100000:2.0:1787190626.461955:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695801216:0@lo:400:kworker.0 00010000:00080000:2.0:1787190626.461967:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17d99f100 x1874004695801728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190626.461977:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695801728:0@lo:400:kworker.0 00000100:00100000:3.0:1787190626.463868:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190626.463890:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695802112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190626.463954:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190626.464004:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802112 00000100:00100000:3.0:1787190626.464010:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802112 00000100:00100000:3.0:1787190626.464055:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787190626.464064:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695802112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787190626.464084:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787190626.464125:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695802112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190626.464132:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787190626.464177:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695802112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190627.092404:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190627.269833:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.269920:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672656384 00000100:00100000:3.0:1787190627.269931:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672656384 00000100:00100000:3.0:1787190627.270001:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00100000:3.0:1787190627.270025:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+13:15617:x1874004672656384:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787190627.270130:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+13:15617:x1874004672656384:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 109us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190627.270138:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 65 00000100:00080000:0.0:1787190627.270323:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190627.274121:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.274326:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672656512 00000100:00100000:3.0:1787190627.274336:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672656512 00000100:00100000:3.0:1787190627.274396:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00100000:3.0:1787190627.274408:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+5:15617:x1874004672656512:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787190627.274519:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+5:15617:x1874004672656512:12345-192.168.202.22@tcp:60:lhsmtool_posix.0 Request processed in 114us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190627.274527:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 66 00000100:00080000:2.0:1787190627.274653:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787190627.276323:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190627.276410:0:17202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672656768 00000100:00100000:1.0:1787190627.276420:0:17202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672656768 00000100:00100000:1.0:1787190627.276489:0:17202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787190627.276498:0:17202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:428c022e-1d42-4aeb-b58c-39fd5adab981+13:15617:x1874004672656768:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787190627.276701:0:17202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:428c022e-1d42-4aeb-b58c-39fd5adab981+14:15617:x1874004672656768:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 204us (384us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1787190627.276709:0:17202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787190627.406414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.406553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.406584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190627.406605:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657152 00000100:00100000:3.0:1787190627.406609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190627.406616:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657152 00000100:00100000:3.0:1787190627.406627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.406645:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190627.406664:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657280 00000100:00100000:0.0:1787190627.406666:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657024 00000100:00100000:3.0:1787190627.406667:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657280 00000100:00100000:0.0:1787190627.406668:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657024 00000100:00100000:0.0:1787190627.406684:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657536 00000100:00100000:0.0:1787190627.406687:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657536 00000100:00100000:0.0:1787190627.406703:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:3.0:1787190627.406704:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657408 00000100:00100000:3.0:1787190627.406707:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657408 00000100:00100000:0.0:1787190627.406714:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2418:x1874004672657152:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190627.406727:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:3.0:1787190627.406733:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2419:x1874004672657280:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190627.406789:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2419:x1874004672657280:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 56us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190627.406802:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:1.0:1787190627.406810:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2417:x1874004672657024:12345-192.168.202.22@tcp:9:kworker.0 00000100:00100000:3.0:1787190627.406812:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 78 00000100:00100000:3.0:1787190627.406828:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 79 00000020:00000080:1.0:1787190627.406830:0:18702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4612 00000100:00100000:3.0:1787190627.406834:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ccb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2418:x1874004672657408:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190627.406910:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672656896 00000100:00100000:2.0:1787190627.406920:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672656896 00000100:00100000:2.0:1787190627.406948:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:2.0:1787190627.406954:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517276-1a85-4932-8208-9c1b6178aeaf+13:2419:x1874004672656896:12345-192.168.202.22@tcp:400:kworker.0 00000100:00080000:1.0:1787190627.406991:0:18702:0:(import.c:65:import_set_state_nolock()) ffff99f165d82800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190627.407038:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787190627.407538:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2418:x1874004672657152:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 824us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190627.407547:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:0.0:1787190627.407564:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:0.0:1787190627.407571:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ccb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2417:x1874004672657536:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:0.0:1787190627.407597:0:19595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4651 00000100:00080000:0.0:1787190627.407603:0:19595:0:(import.c:65:import_set_state_nolock()) ffff99f17c2fa800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787190627.407630:0:19595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1787190627.407696:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ccb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:74e023a8-b5a3-4eb1-af34-2717faa982e1+2:2417:x1874004672657536:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 125us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190627.407703:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00080000:0.0:1787190627.407722:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190627.407726:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190627.407728:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787190627.407730:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787190627.407746:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190627.407987:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ccb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2418:x1874004672657408:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 1151us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190627.407994:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 79 00000100:00100000:2.0:1787190627.408072:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:77517276-1a85-4932-8208-9c1b6178aeaf+13:2419:x1874004672656896:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 1116us (1680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190627.408081:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 168 00000100:00100000:1.0:1787190627.408148:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+2:2417:x1874004672657024:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 1339us (1569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190627.408164:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787190627.408166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190627.408221:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657664 00000100:00100000:1.0:1787190627.408227:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657664 00000100:00100000:1.0:1787190627.408311:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:1.0:1787190627.408318:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ccb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2417:x1874004672657664:12345-192.168.202.22@tcp:9:kworker.0 00000020:00000080:1.0:1787190627.408331:0:18702:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4658 00000100:00080000:1.0:1787190627.408339:0:18702:0:(import.c:65:import_set_state_nolock()) ffff99f17c2fc000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787190627.408366:0:18702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1787190627.408468:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ccb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+2:2417:x1874004672657664:12345-192.168.202.22@tcp:9:kworker.0 Request processed in 150us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190627.408486:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00010000:00010000:1.0:1787190627.408503:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190627.408713:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190627.408749:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787190628.120820:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190628.499104:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787190629.139199:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190630.163572:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190630.546949:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ccb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695802240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190630.547025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190630.547156:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802240 00000100:00100000:0.0:1787190630.547164:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802240 00000100:00100000:0.0:1787190630.547228:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787190630.547237:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695802240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787190630.547264:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1787190630.547421:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190630.547869:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695802240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 630us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190630.547879:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190630.548952:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ccb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695802240:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1787190630.837402:0:20572:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 21:50:29 (1787190629) 00010000:00010000:2.0:1787190631.188364:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190631.571587:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695802624:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190631.571661:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.571721:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190631.571728:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695802496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787190631.571755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.571875:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802496 00000100:00100000:2.0:1787190631.571883:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802496 00000100:00100000:2.0:1787190631.571939:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190631.571950:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695802496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787190631.571978:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787190631.572018:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695802496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572024:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787190631.572044:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190631.572058:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695803136:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.572110:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695803648:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.572166:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695802496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787190631.572184:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1787190631.572189:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695803008:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572211:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.572234:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695803520:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572253:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.572269:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695804032:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572305:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190631.572330:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803136 00000100:00100000:2.0:1787190631.572334:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803136 00000100:00100000:2.0:1787190631.572364:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803008 00000100:00100000:2.0:1787190631.572367:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803008 00000100:00100000:2.0:1787190631.572387:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787190631.572394:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695803136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572448:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695803136:12345-0@lo:400:kworker.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572455:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787190631.572466:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190631.572473:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695803008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572501:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695803008:12345-0@lo:400:kworker.0 Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572507:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190631.572532:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803648 00000100:00100000:2.0:1787190631.572536:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803648 00000100:00100000:2.0:1787190631.572561:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803520 00000100:00100000:2.0:1787190631.572565:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803520 00000100:00100000:2.0:1787190631.572576:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804032 00000100:00100000:2.0:1787190631.572578:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804032 00000100:00100000:2.0:1787190631.572590:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787190631.572596:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695803648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572628:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695803648:12345-0@lo:400:kworker.0 Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572634:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787190631.572645:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787190631.572652:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695803520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572678:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695803520:12345-0@lo:400:kworker.0 Request processed in 26us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572684:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787190631.572695:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787190631.572702:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695804032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572746:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695804032:12345-0@lo:400:kworker.0 Request processed in 44us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.572752:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787190631.572784:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787190631.572788:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787190631.572790:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787190631.572792:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190631.572811:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695803008:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572821:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695803520:0@lo:400:kworker.0 00010000:00080000:2.0:1787190631.572842:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17ddeb480 x1874004695804032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190631.572853:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695804032:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572861:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695803136:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.572870:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695803648:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573643:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695802368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190631.573686:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573707:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695802880:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573756:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695803392:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573795:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695803904:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573838:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787190631.573843:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695802752:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573904:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695803264:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573925:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573939:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695803776:0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.573960:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190631.573990:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802624 00000100:00100000:1.0:1787190631.573997:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802624 00000100:00100000:1.0:1787190631.574035:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802880 00000100:00100000:1.0:1787190631.574038:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802880 00000100:00100000:1.0:1787190631.574056:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190631.574063:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695802624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190631.574098:0:17203:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1787190631.574142:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695802624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190631.574149:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787190631.574163:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787190631.574169:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695802880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190631.574199:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695802880:12345-0@lo:400:kworker.0 Request processed in 31us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190631.574207:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787190631.574241:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695802880:0@lo:400:kworker.0 00000100:00100000:0.0:1787190631.574579:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190631.574591:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ccb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695804160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190631.574626:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190631.574657:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804160 00000100:00100000:0.0:1787190631.574661:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804160 00000100:00100000:0.0:1787190631.574687:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787190631.574695:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695804160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787190631.574721:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787190631.574755:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695804160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190631.574763:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787190631.574782:0:19231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803392 00000100:00100000:0.0:1787190631.574785:0:19231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803392 00000100:00100000:0.0:1787190631.574810:0:19231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787190631.574817:0:19231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695803392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190631.574854:0:19231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695803392:12345-0@lo:400:kworker.0 Request processed in 37us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190631.574860:0:19231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787190631.574889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ccb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695804160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190631.574917:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695803392:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.577863:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802752 00000100:00100000:2.0:1787190631.577873:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802752 00000100:00100000:2.0:1787190631.577922:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787190631.577932:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3652:x1874004695802752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.578006:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3652:x1874004695802752:12345-0@lo:400:kworker.0 Request processed in 76us (4123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.578013:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787190631.578051:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803904 00000100:00100000:2.0:1787190631.578055:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803904 00000100:00100000:2.0:1787190631.578087:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803264 00000100:00100000:2.0:1787190631.578090:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803264 00000100:00100000:2.0:1787190631.578101:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695803776 00000100:00100000:2.0:1787190631.578104:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695803776 00000100:00100000:2.0:1787190631.578118:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787190631.578125:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695803904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.578157:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695803904:12345-0@lo:400:kworker.0 Request processed in 33us (4339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.578163:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787190631.578175:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787190631.578180:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695803264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.578220:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695803264:12345-0@lo:400:kworker.0 Request processed in 39us (4293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.578226:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787190631.578237:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787190631.578244:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695803776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.578268:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695803776:12345-0@lo:400:kworker.0 Request processed in 25us (4307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.578274:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1787190631.578334:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787190631.578339:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190631.578350:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695802368 00000100:00100000:2.0:1787190631.578353:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695802368 00000100:00100000:2.0:1787190631.578379:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190631.578386:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695802368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787190631.578416:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787190631.578482:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695802368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.578489:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190631.578531:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695802752:0@lo:400:kworker.0 00000100:00100000:0.0:1787190631.579041:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695804288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190631.579083:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1787190631.580161:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1787190631.580173:0:17178:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:1.0:1787190631.580190:0:17238:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:1.0:1787190631.580199:0:17238:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00100000:2.0:1787190631.580270:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695803264:0@lo:400:kworker.0 00010000:00080000:2.0:1787190631.580308:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17dde9880 x1874004695803776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190631.580320:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695803776:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.580343:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695802368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190631.580367:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695803904:0@lo:400:kworker.0 00000100:00100000:2.0:1787190631.580426:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804288 00000100:00100000:2.0:1787190631.580431:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804288 00000100:00100000:2.0:1787190631.580483:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787190631.580491:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695804288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190631.580509:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787190631.580577:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695804288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190631.580584:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787190631.580623:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695802624:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190631.582581:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695804288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787190632.214824:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190632.520123:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190632.520269:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657792 00000100:00100000:2.0:1787190632.520280:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657792 00000100:00100000:2.0:1787190632.520367:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 170 00000100:00100000:2.0:1787190632.520383:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517276-1a85-4932-8208-9c1b6178aeaf+13:2421:x1874004672657792:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190632.520467:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517276-1a85-4932-8208-9c1b6178aeaf+13:2421:x1874004672657792:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 86us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190632.520476:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 170 00000100:00100000:3.0:1787190632.521722:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190632.521806:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190632.521828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190632.521849:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190632.521869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190632.521890:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658048 00000100:00100000:3.0:1787190632.521898:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658048 00000100:00100000:3.0:1787190632.521940:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658304 00000100:00100000:3.0:1787190632.521943:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658304 00000100:00100000:3.0:1787190632.521955:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672657920 00000100:00100000:3.0:1787190632.521957:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672657920 00000100:00100000:3.0:1787190632.521969:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658432 00000100:00100000:3.0:1787190632.521972:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658432 00000100:00100000:3.0:1787190632.522786:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:3.0:1787190632.522802:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ccb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2421:x1874004672658048:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190632.522880:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ccb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2421:x1874004672658048:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 84us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190632.522894:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 86 00000100:00100000:3.0:1787190632.522917:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 87 00000100:00100000:3.0:1787190632.522924:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ccb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2421:x1874004672658304:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190632.522949:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ccb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2421:x1874004672658304:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 27us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190632.522955:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 87 00000100:00100000:3.0:1787190632.522965:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 88 00000100:00100000:3.0:1787190632.522971:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+13:2421:x1874004672657920:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190632.523260:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+13:2421:x1874004672657920:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 288us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190632.523268:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 88 00000100:00100000:3.0:1787190632.523280:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:3.0:1787190632.523305:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2421:x1874004672658432:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190632.523326:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2421:x1874004672658432:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 41us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190632.523332:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 89 00000100:00100000:3.0:1787190632.523356:0:18704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658176 00000100:00100000:3.0:1787190632.523360:0:18704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658176 00000100:00100000:3.0:1787190632.523393:0:18704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:3.0:1787190632.523399:0:18704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2421:x1874004672658176:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190632.523420:0:18704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2421:x1874004672658176:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190632.523425:0:18704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00080000:3.0:1787190632.523461:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190632.523465:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190632.523467:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1787190632.608661:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74e023a8-b5a3-4eb1-af34-2717faa982e1 00000020:00000080:0.0:1787190632.608672:0:19518:0:(genops.c:885:class_export_put()) final put ffff99f17c2fb800/74e023a8-b5a3-4eb1-af34-2717faa982e1 00000020:00000080:0.0:1787190632.609505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c2fb800/74e023a8-b5a3-4eb1-af34-2717faa982e1 for lustre-OST0001 00000020:00000080:0.0:1787190632.609561:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c2fc000 for lustre-OST0001 00000001:00100000:1.0:1787190632.611556:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74e023a8-b5a3-4eb1-af34-2717faa982e1 00000020:00000080:1.0:1787190632.611564:0:18699:0:(genops.c:885:class_export_put()) final put ffff99f17c2fd000/74e023a8-b5a3-4eb1-af34-2717faa982e1 00000001:00100000:1.0:1787190632.611636:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:1.0:1787190632.611640:0:18699:0:(genops.c:885:class_export_put()) final put ffff99f165d86000/428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:2.0:1787190632.613332:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c2fd000/74e023a8-b5a3-4eb1-af34-2717faa982e1 for lustre-OST0000 00000020:00000080:2.0:1787190632.613387:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c2fa800 for lustre-OST0000 00000020:00000080:1.0:1787190632.615544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d86000/428c022e-1d42-4aeb-b58c-39fd5adab981 for lustre-OST0000 00000020:00000080:1.0:1787190632.615585:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165d82800 for lustre-OST0000 00000040:00080000:0.0:1787190632.927929:0:17233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787190632.927937:0:17233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787190632.927957:0:17233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787190632.927964:0:17233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787190633.245880:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190634.258807:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190635.282672:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190635.667041:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190635.667066:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695804416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787190635.667148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190635.672067:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804416 00000100:00100000:2.0:1787190635.672083:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804416 00000100:00100000:2.0:1787190635.672241:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787190635.672608:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190635.673050:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695804416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787190635.673106:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787190635.673202:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c632680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695804416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 950us (6052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190635.673210:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787190635.673341:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695804416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190635.730233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190635.730436:0:17201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658688 00000100:00100000:0.0:1787190635.730457:0:17201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658688 00000100:00100000:0.0:1787190635.730521:0:17201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:0.0:1787190635.730534:0:17201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+13:16379:x1874004672658688:12345-192.168.202.22@tcp:35:umount.0 00000001:00080000:0.0:1787190635.730797:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1787190635.731236:0:17201:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00080000:1.0:1787190635.731576:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190635.732351:0:17201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:428c022e-1d42-4aeb-b58c-39fd5adab981+16:16379:x1874004672658688:12345-192.168.202.22@tcp:35:umount.0 Request processed in 891us (1198us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1787190635.732363:0:17201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00000020:00080000:0.0:1787190635.732370:0:17201:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787190635.750267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190635.750385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190635.750438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190635.750473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190635.750506:0:19595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672659200 00000100:00100000:2.0:1787190635.750515:0:19595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672659200 00000100:00100000:2.0:1787190635.750578:0:19595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:2.0:1787190635.750589:0:19595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2417:x1874004672659200:12345-192.168.202.22@tcp:9:umount.0 00000020:00000080:2.0:1787190635.750627:0:19595:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4619 00000100:00080000:2.0:1787190635.750637:0:19595:0:(import.c:65:import_set_state_nolock()) ffff99f165d82000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787190635.750680:0:19595:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787190635.752493:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658816 00000100:00100000:3.0:1787190635.752508:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658816 00000100:00100000:3.0:1787190635.752558:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672659072 00000100:00100000:3.0:1787190635.752561:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672659072 00000100:00100000:3.0:1787190635.752573:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672658944 00000100:00100000:3.0:1787190635.752575:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672658944 00000100:00100000:3.0:1787190635.752596:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787190635.752605:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+15:2421:x1874004672658816:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190635.752619:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190635.752639:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667ba200/0xdedcc04674eb45ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1127b4 expref: 15 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190635.752657:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190635.752721:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+14:2421:x1874004672658816:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 117us (2469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190635.752728:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787190635.752745:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:3.0:1787190635.752751:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c0dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+13:2421:x1874004672659072:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190635.752758:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190635.752767:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb46b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d11289b expref: 13 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190635.752791:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190635.752808:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c0dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+12:2421:x1874004672659072:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 58us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190635.752814:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:3.0:1787190635.752851:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787190635.752868:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+11:2421:x1874004672658944:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190635.752876:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190635.752885:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bbc00/0xdedcc04674eb45f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1127e5 expref: 11 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190635.752894:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190635.752910:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:77517276-1a85-4932-8208-9c1b6178aeaf+10:2421:x1874004672658944:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 54us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190635.752916:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:2.0:1787190635.754176:0:19595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:428c022e-1d42-4aeb-b58c-39fd5adab981+2:2417:x1874004672659200:12345-192.168.202.22@tcp:9:umount.0 Request processed in 3580us (3692us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190635.754188:0:19595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00080000:1.0:1787190635.754943:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787190635.755192:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190635.775195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190635.776515:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660096 00000100:00100000:3.0:1787190635.776531:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660096 00000100:00100000:3.0:1787190635.776613:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 67 00000100:00100000:3.0:1787190635.776626:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+16:2417:x1874004672660096:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:3.0:1787190635.776663:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4604 00000020:00010000:3.0:1787190635.776683:0:17200:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99f165e29000: total 0 00000100:00080000:3.0:1787190635.776688:0:17200:0:(import.c:65:import_set_state_nolock()) ffff99f165e2b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190635.776726:0:17200:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1787190635.776906:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:428c022e-1d42-4aeb-b58c-39fd5adab981+15:2417:x1874004672660096:12345-192.168.202.22@tcp:39:umount.0 Request processed in 283us (1722us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1787190635.776914:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 67 00000020:00010000:0.0:1787190635.777208:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99f165e29000: total 0 00010000:00010000:0.0:1787190635.777213:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190635.777267:0:17186:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff99f165e29000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787190635.777344:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99f1664a4a00) 00010000:00010000:0.0:1787190635.777349:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787190635.777358:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120600/0xdedcc04674eb46eb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1128a9 expref: 14 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777384:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99f1664a4700) 00010000:00010000:0.0:1787190635.777387:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787190635.777390:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5c00/0xdedcc04674eb482d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d11290b expref: 13 pid: 17200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777416:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99f1664a4700) 00010000:00010000:0.0:1787190635.777419:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190635.777423:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4600/0xdedcc04674eb4914 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112958 expref: 12 pid: 19230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777435:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1664a6800) 00010000:00010000:0.0:1787190635.777445:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190635.777449:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5600/0xdedcc04674eb472a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1128b7 expref: 11 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777464:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99f17c2c0100) 00010000:00010000:0.0:1787190635.777466:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190635.777470:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bac00/0xdedcc04674eb48b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112935 expref: 10 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777484:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99f1664a6e00) 00010000:00010000:0.0:1787190635.777487:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190635.777491:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5000/0xdedcc04674eb46cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1128a2 expref: 9 pid: 17199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777506:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99f1664a4c00) 00010000:00010000:0.0:1787190635.777509:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787190635.777513:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f154d10800/0xdedcc04674eb47af lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1128e1 expref: 8 pid: 17197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777528:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99f1664a4700) 00010000:00010000:0.0:1787190635.777530:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190635.777533:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bb800/0xdedcc04674eb485e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112920 expref: 7 pid: 19230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190635.777545:0:17186:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff99f165e29000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1787190635.777559:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190635.777561:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190635.777563:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190635.784914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190635.785149:0:19230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660224 00000100:00100000:2.0:1787190635.785161:0:19230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660224 00000100:00100000:2.0:1787190635.785248:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 68 00000100:00100000:2.0:1787190635.785259:0:19230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:428c022e-1d42-4aeb-b58c-39fd5adab981+5:2417:x1874004672660224:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:2.0:1787190635.785320:0:19230:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb460b 00000100:00080000:2.0:1787190635.785341:0:19230:0:(import.c:65:import_set_state_nolock()) ffff99f165e8a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787190635.785418:0:19230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1787190635.785516:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787190635.785921:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787190635.786349:0:19230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c631f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:428c022e-1d42-4aeb-b58c-39fd5adab981+3:2417:x1874004672660224:12345-192.168.202.22@tcp:39:umount.0 Request processed in 1079us (1434us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787190635.786360:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 68 00010000:00010000:0.0:1787190636.307532:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190636.690755:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695804544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190636.690837:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190636.691047:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804544 00000100:00100000:3.0:1787190636.691060:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804544 00000100:00100000:3.0:1787190636.691115:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787190636.691126:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695804544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190636.691160:0:17204:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190636.691210:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695804544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190636.691217:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787190636.691324:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695804544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787190636.692273:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190636.692304:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695804672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787190636.692361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.692602:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190636.692612:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695804800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190636.692657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.692684:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804672 00000100:00100000:1.0:1787190636.692690:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804672 00000100:00100000:1.0:1787190636.692729:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804800 00000100:00100000:1.0:1787190636.692732:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804800 00000100:00100000:1.0:1787190636.692749:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190636.692756:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695804672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1787190636.692781:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787190636.692815:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695804672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190636.692821:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190636.692833:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190636.692839:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695804800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787190636.692870:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787190636.692901:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695804800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190636.692916:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1787190636.692932:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787190636.692935:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190636.692962:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695804800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787190636.693052:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695805184:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693096:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695805696:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693114:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693129:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1787190636.693135:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695805056:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693157:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693173:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695805568:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693191:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693205:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695806080:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693221:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693240:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695804928:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693285:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695805440:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693327:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693354:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695805952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693387:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787190636.693402:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695805312:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693425:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693452:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695805824:0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.693506:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805312 00000100:00100000:1.0:1787190636.693510:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805312 00000100:00100000:1.0:1787190636.693535:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190636.693541:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695805312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190636.693576:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695805312:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190636.693581:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190636.693602:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695805312:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.693824:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805056 00000100:00100000:2.0:1787190636.693829:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805056 00000100:00100000:2.0:1787190636.693869:0:18705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805440 00000100:00100000:2.0:1787190636.693872:0:18705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805440 00000100:00100000:2.0:1787190636.693897:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190636.693904:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695805056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.693942:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695805056:12345-0@lo:400:kworker.0 Request processed in 39us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.693948:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190636.693959:0:18705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190636.693965:0:18705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695805440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.693995:0:18705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695805440:12345-0@lo:400:kworker.0 Request processed in 31us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694001:0:18705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190636.694017:0:17193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695804928 00000100:00100000:2.0:1787190636.694021:0:17193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695804928 00000100:00100000:2.0:1787190636.694045:0:17193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787190636.694051:0:17193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3652:x1874004695804928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694079:0:17193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3652:x1874004695804928:12345-0@lo:400:kworker.0 Request processed in 28us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694094:0:17193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787190636.694122:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805184 00000100:00100000:2.0:1787190636.694126:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805184 00000100:00100000:2.0:1787190636.694141:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805696 00000100:00100000:2.0:1787190636.694144:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805696 00000100:00100000:2.0:1787190636.694154:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805568 00000100:00100000:2.0:1787190636.694156:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805568 00000100:00100000:2.0:1787190636.694166:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806080 00000100:00100000:2.0:1787190636.694169:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806080 00000100:00100000:2.0:1787190636.694179:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805952 00000100:00100000:2.0:1787190636.694181:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805952 00000100:00100000:2.0:1787190636.694192:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695805824 00000100:00100000:2.0:1787190636.694194:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695805824 00000100:00100000:2.0:1787190636.694205:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787190636.694211:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695805184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694241:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166533480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695805184:12345-0@lo:400:kworker.0 Request processed in 30us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694247:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787190636.694257:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787190636.694263:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695805696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694311:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695805696:12345-0@lo:400:kworker.0 Request processed in 48us (1195us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694316:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787190636.694328:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787190636.694345:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695805568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694373:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695805568:12345-0@lo:400:kworker.0 Request processed in 39us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694378:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787190636.694406:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787190636.694413:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695806080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694440:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695806080:12345-0@lo:400:kworker.0 Request processed in 29us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694445:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787190636.694456:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787190636.694460:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695805952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.694484:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695805952:12345-0@lo:400:kworker.0 Request processed in 24us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.694490:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787190636.695230:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787190636.695241:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695805824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695280:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695805824:12345-0@lo:400:kworker.0 Request processed in 42us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190636.695320:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787190636.695791:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695805056:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695806:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695805568:0@lo:400:kworker.0 00010000:00080000:2.0:1787190636.695821:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17cf68700 x1874004695806080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190636.695832:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695806080:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695845:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695805184:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695857:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695805696:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695911:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695804672:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1787190636.695953:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17cf68a80 x1874004695805824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190636.695962:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695805824:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695973:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695804928:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695984:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695805440:0@lo:400:kworker.0 00000100:00100000:2.0:1787190636.695995:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695805952:0@lo:400:kworker.0 00000100:00080000:1.0:1787190636.699980:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787190636.699992:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190636.699997:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190636.700252:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190636.700279:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695806208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190636.700436:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190636.700997:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190636.701014:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695806336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190636.701052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190636.701177:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806208 00000100:00100000:1.0:1787190636.701186:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806208 00000100:00100000:1.0:1787190636.701242:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787190636.701252:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695806208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190636.701274:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1787190636.701635:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c6a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695806208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 372us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190636.701643:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787190636.701782:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695806208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190636.701854:0:19861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806336 00000100:00100000:0.0:1787190636.701860:0:19861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806336 00000100:00100000:0.0:1787190636.701894:0:19861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787190636.701902:0:19861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695806336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787190636.701929:0:19861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1787190636.701976:0:19861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695806336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190636.701982:0:19861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787190636.702052:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695806336:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787190637.333036:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190637.642827:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190637.642878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190637.642914:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190637.642984:0:19230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660480 00000100:00100000:0.0:1787190637.642993:0:19230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660480 00000100:00100000:3.0:1787190637.643003:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660352 00000100:00100000:3.0:1787190637.643010:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660352 00000100:00100000:0.0:1787190637.643059:0:19230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660608 00000100:00100000:3.0:1787190637.643060:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 172 00000100:00100000:0.0:1787190637.643065:0:19230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660608 00000100:00100000:3.0:1787190637.643074:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77517276-1a85-4932-8208-9c1b6178aeaf+10:2420:x1874004672660352:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787190637.643104:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:0.0:1787190637.643114:0:19230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2421:x1874004672660480:12345-192.168.202.22@tcp:400:kworker.0 00000100:00080000:1.0:1787190637.643175:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787190637.643180:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787190637.643210:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:1.0:1787190637.643220:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2420:x1874004672660608:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190637.643506:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:77517276-1a85-4932-8208-9c1b6178aeaf+10:2420:x1874004672660352:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 433us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190637.643514:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 172 00000100:00100000:0.0:1787190637.649166:0:19230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2421:x1874004672660480:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 6039us (6336us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190637.649181:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 96 00000100:00100000:1.0:1787190637.651651:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2420:x1874004672660608:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 8420us (8723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190637.651666:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 97 00000100:00100000:2.0:1787190638.065232:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190638.065341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190638.065541:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660736 00000100:00100000:1.0:1787190638.065553:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660736 00000100:00100000:1.0:1787190638.065622:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660864 00000100:00100000:1.0:1787190638.065626:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660864 00000100:00100000:1.0:1787190638.065646:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787190638.065656:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+11:2419:x1874004672660736:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190638.065671:0:17185:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190638.065691:0:17185:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158120200/0xdedcc04674eb462e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112824 expref: 11 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190638.065711:0:17185:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190638.065771:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+10:2419:x1874004672660736:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 116us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190638.065778:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787190638.065794:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787190638.065800:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+9:2419:x1874004672660864:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190638.065807:0:17185:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190638.065817:0:17185:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039ee00/0xdedcc04674eb4635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112855 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190638.065826:0:17185:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190638.065844:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+8:2419:x1874004672660864:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 44us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190638.065865:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787190638.069590:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190638.070525:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672660992 00000100:00100000:1.0:1787190638.070536:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672660992 00000100:00100000:1.0:1787190638.070614:0:17185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787190638.070626:0:17185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+8:2421:x1874004672660992:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190638.070643:0:17185:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190638.070663:0:17185:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1703b5200/0xdedcc04674eb46ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112894 expref: 8 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190638.070681:0:17185:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190638.070746:0:17185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:77517276-1a85-4932-8208-9c1b6178aeaf+7:2421:x1874004672660992:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 122us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190638.070753:0:17185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:3.0:1787190638.075014:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190638.075099:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672661248 00000100:00100000:2.0:1787190638.075109:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672661248 00000100:00100000:2.0:1787190638.075171:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:2.0:1787190638.075182:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74e023a8-b5a3-4eb1-af34-2717faa982e1+6:2417:x1874004672661248:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:2.0:1787190638.075225:0:17199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4643 00000020:00010000:2.0:1787190638.075236:0:17199:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99f1581cd000: total 0 00000100:00080000:2.0:1787190638.075241:0:17199:0:(import.c:65:import_set_state_nolock()) ffff99f1581c9000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787190638.075667:0:17199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1787190638.075805:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c6a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2417:x1874004672661248:12345-192.168.202.22@tcp:39:umount.0 Request processed in 623us (798us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1787190638.075813:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 69 00000100:00100000:3.0:1787190638.078909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190638.079081:0:19230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672661376 00000100:00100000:2.0:1787190638.079091:0:19230:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672661376 00000100:00100000:2.0:1787190638.079147:0:19230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:2.0:1787190638.079157:0:19230:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74e023a8-b5a3-4eb1-af34-2717faa982e1+5:2417:x1874004672661376:12345-192.168.202.22@tcp:39:umount.0 00000020:00000080:2.0:1787190638.079195:0:19230:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb464a 00000100:00080000:2.0:1787190638.079207:0:19230:0:(import.c:65:import_set_state_nolock()) ffff99f170317800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1787190638.079510:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99f1581cd000: total 0 00010000:00010000:0.0:1787190638.079565:0:17186:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff99f1581cd000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787190638.079611:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1664a6800) 00010000:00010000:0.0:1787190638.079615:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787190638.079623:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4800/0xdedcc04674eb4738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1128be expref: 4 pid: 19230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190638.079664:0:17186:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff99f1581cd000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787190638.079679:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190638.079681:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190638.079683:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190638.084182:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787190638.088958:0:19230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1787190638.089183:0:19230:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74e023a8-b5a3-4eb1-af34-2717faa982e1+3:2417:x1874004672661376:12345-192.168.202.22@tcp:39:umount.0 Request processed in 10022us (10277us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787190638.089196:0:19230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 70 00000100:00100000:3.0:1787190638.125430:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190638.125539:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672661632 00000100:00100000:2.0:1787190638.125549:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672661632 00000100:00100000:2.0:1787190638.125624:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 173 00000100:00100000:2.0:1787190638.125636:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517276-1a85-4932-8208-9c1b6178aeaf+7:2417:x1874004672661632:12345-192.168.202.22@tcp:251:umount.0 00000020:00000080:2.0:1787190638.125685:0:17192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb45e1 00000020:00010000:2.0:1787190638.125693:0:17192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99f165d47000: total 0 00000100:00080000:2.0:1787190638.125699:0:17192:0:(import.c:65:import_set_state_nolock()) ffff99f165d44000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787190638.125773:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:77517276-1a85-4932-8208-9c1b6178aeaf+3:2417:x1874004672661632:12345-192.168.202.22@tcp:251:umount.0 Request processed in 140us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190638.125781:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 173 00000020:00010000:1.0:1787190638.125913:0:17186:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99f165d47000: total 0 00010000:00010000:1.0:1787190638.125917:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190638.125966:0:17186:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff99f165d47000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787190638.125999:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039fe00/0xdedcc04674eb45e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1127ad expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190638.126014:0:17186:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff99f165d47000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1787190638.126025:0:17186:0:(genops.c:885:class_export_put()) final put ffff99f165d47000/77517276-1a85-4932-8208-9c1b6178aeaf 00010000:00010000:1.0:1787190638.126042:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190638.126044:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190638.126046:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787190638.126149:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d47000/77517276-1a85-4932-8208-9c1b6178aeaf for MGS 00000020:00000080:2.0:1787190638.134998:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165d44000 for MGS 00010000:00010000:0.0:1787190638.354891:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787190638.749777:0:17951:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787190639.381779:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787190640.071497:0:20767:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787190640.096486:0:20767:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787190640.096546:0:20767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.096580:0:20767:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.096588:0:20767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.096595:0:20767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.096619:0:20767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787190640.096625:0:20767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787190640.096649:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787190640.096653:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787190640.096659:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787190640.096683:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f17c439800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787190640.096788:0:17187:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190640.096796:0:17187:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.096803:0:17187:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56f200 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190640.096807:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.096815:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190640.096822:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190640.096828:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190640.096831:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787190640.096833:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787190640.096860:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.096866:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190640.096896:0:17187:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.096910:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17c56f200/0xdedcc04674eb41a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ab expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.096922:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190640.096923:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190640.096925:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190640.096970:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695806592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190640.097036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190640.097144:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695806464:0@lo:39:umount.0 00000100:00100000:2.0:1787190640.097179:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190640.097375:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806464 00000100:00100000:3.0:1787190640.097383:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806464 00000100:00100000:3.0:1787190640.097476:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787190640.097486:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874004695806464:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787190640.097510:0:17200:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb41d5 00000100:00080000:3.0:1787190640.097518:0:17200:0:(import.c:65:import_set_state_nolock()) ffff99f143e70800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787190640.097580:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3650:x1874004695806464:12345-0@lo:39:umount.0 Request processed in 96us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190640.097588:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1787190640.097597:0:17200:0:(genops.c:885:class_export_put()) final put ffff99f143e71000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787190640.097625:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f143e71000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787190640.097668:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f143e70800 for lustre-MDT0000 00000100:00080000:3.0:1787190640.097702:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c439800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787190640.097710:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695806464:0@lo:39:umount.0 00010000:00010000:1.0:1787190640.097831:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787190640.097841:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787190640.097843:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787190640.097847:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787190640.097916:0:20767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097925:0:20767:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097932:0:20767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097948:0:20767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097962:0:20767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787190640.097969:0:20767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097975:0:20767:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097982:0:20767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.097988:0:20767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098000:0:20767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787190640.098008:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190640.098011:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098018:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56e600 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190640.098022:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098028:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190640.098035:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190640.098145:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190640.098148:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787190640.098169:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098175:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190640.098193:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098200:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17c56e600/0xdedcc04674eb40f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40fc expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098211:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190640.098214:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098219:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5400 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190640.098222:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098229:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190640.098235:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190640.098240:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190640.098243:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787190640.098244:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787190640.098264:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098270:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190640.098277:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098283:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb45d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45da expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.098316:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190640.098317:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190640.098319:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190640.098329:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3654:1874004695806848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190640.098436:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787190640.099041:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190640.099055:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695806720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190640.099544:0:20767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099555:0:20767:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099569:0:20767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099576:0:20767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099590:0:20767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787190640.099600:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190640.099605:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099623:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039fa00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190640.099626:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099632:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190640.099639:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190640.099645:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787190640.099647:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787190640.099649:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787190640.099673:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099679:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190640.099696:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099703:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039fa00/0xdedcc04674eb469e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb46a5 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190640.099712:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190640.099714:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190640.099715:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190640.099726:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190640.099736:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695806976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190640.099769:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190640.099894:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806592 00000100:00100000:0.0:1787190640.099901:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806592 00000100:00100000:0.0:1787190640.099950:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806848 00000100:00100000:0.0:1787190640.099954:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806848 00000100:00100000:0.0:1787190640.099971:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190640.099980:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+25:3652:x1874004695806592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.099992:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190640.100012:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f182044e00/0xdedcc04674eb41ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb41a4 expref: 25 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.100026:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190640.100060:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+24:3652:x1874004695806592:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3025us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.100067:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787190640.100081:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190640.100087:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+23:3654:x1874004695806848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.100094:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190640.100102:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bba00/0xdedcc04674eb45da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb45d3 expref: 23 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.100111:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190640.100151:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+22:3654:x1874004695806848:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.100158:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190640.100192:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3654:1874004695806848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190640.100265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190640.100729:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806720 00000100:00100000:0.0:1787190640.100735:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806720 00000100:00100000:0.0:1787190640.100760:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190640.100767:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+22:3653:x1874004695806720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.100775:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190640.100785:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a7a00/0xdedcc04674eb40fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb40f5 expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.100794:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190640.100827:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+21:3653:x1874004695806720:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.100834:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190640.100884:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695806720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.102610:0:20767:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.102626:0:20767:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.102633:0:20767:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.102640:0:20767:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.102692:0:20767:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787190640.102700:0:20767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787190640.102709:0:20767:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787190640.102748:0:20767:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787190640.102752:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787190640.102756:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190640.102762:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1787190640.102769:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99f165e2c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190640.102774:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99f17c68d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190640.102779:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99f17c4eb800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190640.102783:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99f15ff49800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190640.102789:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99f1581cd000 74e023a8-b5a3-4eb1-af34-2717faa982e1 192.168.202.22@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1787190640.102794:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff99f165e29000 428c022e-1d42-4aeb-b58c-39fd5adab981 192.168.202.22@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1787190640.102799:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99f17c378000) has exports, disconnecting them 00000020:00080000:0.0:1787190640.102803:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99f165e2c000), last request at 1787190636 00000020:00000080:0.0:1787190640.102809:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb440c 00000100:00080000:0.0:1787190640.102825:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f165e2f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787190640.102872:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f165e2c000): rc 0 00000020:00000080:0.0:1787190640.102874:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f165e2c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787190640.102891:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99f17c68d000), last request at 1787190636 00000020:00000080:0.0:1787190640.102895:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4372 00000100:00080000:0.0:1787190640.102900:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f17c688800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787190640.102906:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f17c68d000): rc 0 00000020:00000080:0.0:1787190640.102908:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17c68d000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1787190640.102912:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99f17c4eb800), last request at 1787190564 00000020:00000080:0.0:1787190640.102922:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb42c3 00000100:00080000:0.0:1787190640.102926:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f17c4e8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787190640.102933:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f17c4eb800): rc 0 00000020:00000080:0.0:1787190640.102935:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17c4eb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1787190640.102939:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99f15ff49800), last request at 1787190564 00000020:00000080:0.0:1787190640.102942:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb425a 00000100:00080000:0.0:1787190640.102945:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f17d08e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787190640.102950:0:20767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:0.0:1787190640.103026:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f15ff49800): rc 0 00000004:00000080:0.0:1787190640.103032:0:20767:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb85582083ae0 00000100:00080000:0.0:1787190640.103049:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787190640.103052:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787190640.103062:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1787190640.103083:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f15eabd000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787190640.103166:0:17187:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190640.103174:0:17187:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190640.103182:0:17187:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56fe00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:2.0:1787190640.103186:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190640.103201:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190640.103209:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190640.103215:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190640.103217:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1787190640.103219:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1787190640.103241:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190640.103247:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190640.103267:0:17187:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190640.103274:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17c56fe00/0xdedcc04674eb40e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb40ee expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190640.103309:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190640.103311:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190640.103313:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190640.103426:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190640.103444:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695807232:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.104485:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787190640.106536:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165e2c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787190640.106600:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c68d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1787190640.106624:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c4eb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1787190640.106649:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165e2f000 for lustre-MDT0000 00000020:00000080:3.0:1787190640.106654:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c688800 for lustre-MDT0000 00000020:00000080:3.0:1787190640.106657:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c4e8800 for lustre-MDT0000 00000100:00100000:0.0:1787190640.106751:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807104:0@lo:39:umount.0 00000100:00100000:0.0:1787190640.106828:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190640.106923:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807104 00000100:00100000:2.0:1787190640.106931:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807104 00000100:00100000:2.0:1787190640.106984:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787190640.106994:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1874004695807104:12345-0@lo:39:umount.0 00000020:00000080:2.0:1787190640.107022:0:17204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb42ed 00000100:00080000:2.0:1787190640.107031:0:17204:0:(import.c:65:import_set_state_nolock()) ffff99f1667f2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787190640.107056:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1787190640.107204:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3650:x1874004695807104:12345-0@lo:39:umount.0 Request processed in 211us (375us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787190640.107211:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1787190640.107232:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190640.107259:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15eabd000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787190640.107267:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807104:0@lo:39:umount.0 00000100:00100000:1.0:1787190640.107891:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695806592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190640.107953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190640.108075:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695806976 00000100:00100000:0.0:1787190640.108082:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695806976 00000100:00100000:0.0:1787190640.108136:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807232 00000100:00100000:0.0:1787190640.108139:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807232 00000100:00100000:0.0:1787190640.108176:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190640.108184:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+22:3652:x1874004695806976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.108195:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190640.108214:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039fc00/0xdedcc04674eb46a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb469e expref: 22 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.108243:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190640.108283:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+21:3652:x1874004695806976:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (8512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.108317:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787190640.108333:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190640.108339:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+20:3651:x1874004695807232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190640.108347:0:17184:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190640.108356:0:17184:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158120800/0xdedcc04674eb40ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb40e7 expref: 20 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190640.108566:0:17184:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190640.108602:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+19:3651:x1874004695807232:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.108609:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190640.108668:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695807232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190640.108783:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695806976:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787190640.109843:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787190640.109849:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1787190640.109873:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787190640.109879:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787190640.109903:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f146a4c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787190640.109959:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807360:0@lo:9:umount.0 00000100:00100000:2.0:1787190640.110007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787190640.110059:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787190640.110062:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1787190640.110070:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787190640.110075:0:20767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787190640.110110:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f17d088800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787190640.110626:0:19231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807360 00000100:00100000:3.0:1787190640.110633:0:19231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807360 00000100:00100000:3.0:1787190640.110696:0:19231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190640.110704:0:19231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874004695807360:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787190640.110734:0:19231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb442f 00000100:00080000:3.0:1787190640.110741:0:19231:0:(import.c:65:import_set_state_nolock()) ffff99f165eaa000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190640.110780:0:19231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:1.0:1787190640.110954:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190640.113653:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807488:0@lo:9:umount.0 00000100:00100000:2.0:1787190640.113727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190640.114021:0:19231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3650:x1874004695807360:12345-0@lo:9:umount.0 Request processed in 3316us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190640.114031:0:19231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190640.114055:0:19231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807488 00000100:00100000:3.0:1787190640.114062:0:19231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807488 00000100:00100000:3.0:1787190640.114113:0:19231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787190640.114123:0:19231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1874004695807488:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787190640.114145:0:19231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4436 00000100:00080000:3.0:1787190640.114153:0:19231:0:(import.c:65:import_set_state_nolock()) ffff99f165eaf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190640.114201:0:19231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00080000:2.0:1787190640.114275:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f146a4c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787190640.114300:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787190640.114302:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787190640.114306:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807360:0@lo:9:umount.0 00000100:00100000:3.0:1787190640.114352:0:19231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3650:x1874004695807488:12345-0@lo:9:umount.0 Request processed in 231us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190640.114368:0:19231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1787190640.114402:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190640.114408:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787190640.114602:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d088800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787190640.114616:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787190640.114617:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787190640.114621:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695807488:0@lo:9:umount.0 00000100:00080000:1.0:1787190640.114888:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1787190640.114936:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99f17c378000) has no exports 00000020:00080000:1.0:1787190640.123762:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99f17c378000) has no exports 00000020:00000080:1.0:1787190640.123783:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4142 00000020:00000080:1.0:1787190640.123794:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17c31a000/lustre-QMT0000_UUID 00000020:01000000:1.0:1787190640.123815:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787190640.123822:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190640.123832:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787190640.123836:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99f17c130000) has no exports 00000020:00000080:2.0:1787190640.124606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c31a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787190640.124624:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb413b 00000020:00000080:1.0:1787190640.124632:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f143201800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787190640.124730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f143201800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787190640.124796:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190640.124804:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787190640.124807:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17c31c000/lustre-QMT0000_UUID 00000020:00000080:1.0:1787190640.124810:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c31c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1787190640.124818:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787190640.405485:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190640.788827:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190640.791988:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695807616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190640.792077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190640.793444:0:18707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807616 00000100:00100000:0.0:1787190640.793455:0:18707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807616 00000100:00100000:0.0:1787190640.793595:0:18707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787190640.793619:0:18707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695807616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787190640.795135:0:18707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190640.795218:0:18707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695807616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1599us (3139us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190640.795227:0:18707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190640.795461:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695807616:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787190640.799767:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787190641.435171:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190641.810953:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695807744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787190641.811027:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190641.811084:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807744 00000100:00100000:2.0:1787190641.811093:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807744 00000100:00100000:2.0:1787190641.811145:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787190641.811154:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695807744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787190641.811186:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787190641.811231:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695807744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190641.811239:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787190641.811284:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695807744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1787190641.812052:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695807872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190641.812092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190641.812715:0:17203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695807872 00000100:00100000:1.0:1787190641.812726:0:17203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695807872 00000100:00100000:1.0:1787190641.812766:0:17203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787190641.812775:0:17203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1874004695807872:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1787190641.812783:0:17203:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1787190641.812832:0:17203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3651:x1874004695807872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (739us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190641.812840:0:17203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:02020000:1.0:1787190641.812883:0:3651:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1787190641.815702:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190641.816160:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695808128:0@lo:400:kworker.0 00000100:00100000:0.0:1787190641.816239:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190641.816268:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874004695808640:0@lo:400:kworker.0 00000100:00100000:0.0:1787190641.816315:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190641.816339:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787190641.816358:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695808256:0@lo:400:kworker.0 00000100:00100000:0.0:1787190641.816381:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190641.816397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695808768:0@lo:400:kworker.0 00000100:00100000:0.0:1787190641.816421:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190641.816450:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808640 00000100:00100000:0.0:1787190641.816458:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808640 00000100:00100000:0.0:1787190641.816497:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808256 00000100:00100000:0.0:1787190641.816501:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808256 00000100:00100000:0.0:1787190641.816510:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808768 00000100:00100000:0.0:1787190641.816512:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808768 00000100:00100000:0.0:1787190641.816544:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787190641.816554:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695808768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190641.816602:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695808768:12345-0@lo:400:kworker.0 Request processed in 49us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190641.816609:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787190641.816626:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787190641.816630:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1874004695808640:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787190641.816645:0:17197:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787190641.816668:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1874004695808640:12345-0@lo:400:kworker.0 Request processed in 36us (353us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787190641.816674:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787190641.816685:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787190641.816688:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1874004695808256:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787190641.816693:0:17197:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787190641.816710:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3653:x1874004695808256:12345-0@lo:400:kworker.0 Request processed in 21us (328us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787190641.816716:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787190641.816731:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190641.816752:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787190641.816757:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f15818f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787190641.816761:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1787190641.816840:0:18702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808128 00000100:00100000:3.0:1787190641.816844:0:18702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808128 00000100:00100000:3.0:1787190641.816872:0:18702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787190641.816879:0:18702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695808128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.816913:0:18702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695808128:12345-0@lo:400:kworker.0 Request processed in 35us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190641.816919:0:18702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787190641.816949:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695808000:0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.816987:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190641.817015:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695808512:0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190641.817056:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787190641.817061:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874004695808384:0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817081:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190641.817105:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808000 00000100:00100000:3.0:1787190641.817109:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808000 00000100:00100000:3.0:1787190641.817135:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787190641.817142:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15875cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+19:3652:x1874004695808000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817175:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15875cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f+19:3652:x1874004695808000:12345-0@lo:400:kworker.0 Request processed in 34us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190641.817181:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1787190641.817208:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808512 00000100:00100000:3.0:1787190641.817212:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808512 00000100:00100000:3.0:1787190641.817235:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808384 00000100:00100000:3.0:1787190641.817238:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808384 00000100:00100000:3.0:1787190641.817249:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787190641.817255:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695808512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817282:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c6a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1874004695808512:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190641.817306:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787190641.817319:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787190641.817324:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874004695808384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1787190641.817329:0:17199:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1787190641.817363:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3652:x1874004695808384:12345-0@lo:400:kworker.0 Request processed in 38us (281us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787190641.817376:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787190641.817408:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787190641.817411:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99f165d41800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1787190641.817414:0:3652:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1787190641.817420:0:3652:0:(import.c:65:import_set_state_nolock()) ffff99f165d41800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190641.817423:0:3652:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 557 00000100:00080000:3.0:1787190641.817429:0:3652:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99f165d41800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190641.817455:0:3652:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17c009180 x1874004695808896/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190641.817478:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3652:1874004695808384:0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817490:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695808000:0@lo:400:kworker.0 00010000:00080000:3.0:1787190641.817500:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1483fc000 x1874004695808512/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190641.817510:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3652:1874004695808512:0@lo:400:kworker.0 00000100:00100000:3.0:1787190641.817535:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695808896:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1787190641.817560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190641.817585:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695808896 00000100:00100000:3.0:1787190641.817588:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695808896 00000100:00100000:3.0:1787190641.817604:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787190641.817608:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874004695808896:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1787190641.817624:0:17199:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787190641.817675:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3650:x1874004695808896:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (113us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787190641.817689:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787190641.817714:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f165d41800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190641.817719:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190641.817722:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695808896:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1787190641.817752:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787190641.829148:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787190641.829174:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99f17c592800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787190641.829180:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787190641.829186:0:3651:0:(import.c:65:import_set_state_nolock()) ffff99f17c592800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190641.829190:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:1.0:1787190641.829261:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99f17c592800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190641.829520:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffa9180 x1874004695809024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190641.829938:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695809024:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1787190641.830011:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190641.830465:0:19861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809024 00000100:00100000:1.0:1787190641.830475:0:19861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809024 00000100:00100000:1.0:1787190641.830514:0:19861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787190641.830523:0:19861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874004695809024:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1787190641.830542:0:19861:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1787190641.830593:0:19861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3650:x1874004695809024:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 70us (581us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190641.830600:0:19861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787190641.830659:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c592800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190641.830664:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787190641.830668:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695809024:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:2.0:1787190641.831226:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190641.831232:0:19518:0:(genops.c:885:class_export_put()) final put ffff99f165ead000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787190641.831255:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:2.0:1787190641.831257:0:19518:0:(genops.c:885:class_export_put()) final put ffff99f165d85800/428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:1.0:1787190641.831732:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165ead000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787190641.831788:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d85800/428c022e-1d42-4aeb-b58c-39fd5adab981 for lustre-OST0001 00000020:00000080:1.0:1787190641.831808:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165eaf000 for lustre-OST0001 00000020:00000080:1.0:1787190641.831814:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165d82000 for lustre-OST0001 00000001:00100000:2.0:1787190641.832236:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787190641.832241:0:17178:0:(genops.c:885:class_export_put()) final put ffff99f15ff49800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787190641.832264:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74e023a8-b5a3-4eb1-af34-2717faa982e1 00000001:00080000:2.0:1787190641.832271:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1787190641.832274:0:17178:0:(genops.c:885:class_export_put()) final put ffff99f1581cd000/74e023a8-b5a3-4eb1-af34-2717faa982e1 00000001:00100000:2.0:1787190641.832328:0:17178:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 428c022e-1d42-4aeb-b58c-39fd5adab981 00000001:00080000:2.0:1787190641.832333:0:17178:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1787190641.832340:0:17178:0:(genops.c:885:class_export_put()) final put ffff99f165e29000/428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:1.0:1787190641.832589:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff49800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1787190641.832646:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1581cd000/74e023a8-b5a3-4eb1-af34-2717faa982e1 for lustre-MDT0000 00000020:00000080:1.0:1787190641.832674:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165e29000/428c022e-1d42-4aeb-b58c-39fd5adab981 for lustre-MDT0000 00000020:00000080:1.0:1787190641.832715:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17d08e800 for lustre-MDT0000 00000020:00000080:1.0:1787190641.832719:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f1581c9000 for lustre-MDT0000 00000020:00000080:1.0:1787190641.832723:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165e2b000 for lustre-MDT0000 00000100:00080000:0.0:1787190641.872640:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f15818f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190641.872655:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 542 00000100:00080000:0.0:1787190641.872665:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99f15818f000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190641.873063:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffa9180 x1874004695809152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190641.873104:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695808256:0@lo:400:kworker.0 00010000:00080000:1.0:1787190641.873144:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1483fd500 x1874004695808768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190641.873156:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695808768:0@lo:400:kworker.0 00000100:00100000:1.0:1787190641.873173:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695808128:0@lo:400:kworker.0 00000100:00080000:1.0:1787190641.873185:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787190641.873189:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787190641.873192:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787190641.873196:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190641.873210:0:3653:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 571 00000100:00080000:1.0:1787190641.873216:0:3653:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99f165edf800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190641.873230:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffaaa00 x1874004695809280/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190641.873239:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3653:1874004695808640:0@lo:400:kworker.0 00000100:00100000:2.0:1787190641.873423:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874004695809152:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787190641.873496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190641.873537:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695809280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1787190641.873583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190641.873722:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809152 00000100:00100000:3.0:1787190641.873729:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809152 00000100:00100000:3.0:1787190641.873772:0:17200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809280 00000100:00100000:3.0:1787190641.873775:0:17200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809280 00000100:00100000:3.0:1787190641.873795:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787190641.873803:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695809152:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787190641.873819:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787190641.873861:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695809152:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 58us (364us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787190641.873868:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787190641.873883:0:17200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190641.873887:0:17200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695809280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787190641.873893:0:17200:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787190641.873915:0:17200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695809280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (332us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787190641.873920:0:17200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787190641.873948:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15818f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190641.873954:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190641.873956:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874004695809152:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:3.0:1787190641.873964:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190641.873967:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190641.873978:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695809280:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1787190641.875207:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787190641.875220:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1787190641.875225:0:17931:0:(genops.c:885:class_export_put()) final put ffff99f1667f7000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1787190641.875243:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74e023a8-b5a3-4eb1-af34-2717faa982e1 00000001:00080000:0.0:1787190641.875248:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1787190641.875250:0:17931:0:(genops.c:885:class_export_put()) final put ffff99f165d81800/74e023a8-b5a3-4eb1-af34-2717faa982e1 00000001:00100000:0.0:1787190641.875254:0:17931:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 428c022e-1d42-4aeb-b58c-39fd5adab981 00000001:00080000:0.0:1787190641.875257:0:17931:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1787190641.875259:0:17931:0:(genops.c:885:class_export_put()) final put ffff99f165e2a800/428c022e-1d42-4aeb-b58c-39fd5adab981 00000020:00000080:2.0:1787190641.875680:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1667f7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1787190641.875731:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d81800/74e023a8-b5a3-4eb1-af34-2717faa982e1 for lustre-MDT0001 00000020:00000080:2.0:1787190641.875752:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165e2a800/428c022e-1d42-4aeb-b58c-39fd5adab981 for lustre-MDT0001 00000020:00000080:2.0:1787190641.875772:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f1667f2000 for lustre-MDT0001 00000020:00000080:2.0:1787190641.875776:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f170317800 for lustre-MDT0001 00000020:00000080:2.0:1787190641.875780:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165e8a000 for lustre-MDT0001 00000020:01000000:1.0:1787190642.130504:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f15ff0eb40 - data ffff99f1705c61b0/ffff99f165f75000 00000020:01000000:1.0:1787190642.130682:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f1433dd360 - data ffff99f151bf3288/ffff99f148688400 00000001:00000004:1.0:1787190642.135831:0:20767:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:1.0:1787190642.157264:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787190642.157281:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787190642.157735:0:20767:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff99f17d99f800 x1874004695807104/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787190650 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190642.157762:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787190642.158014:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787190642.158017:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1787190642.158037:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190642.158039:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1787190642.158252:0:17222:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1787190642.158257:0:17222:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1787190642.158269:0:17222:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1787190642.159199:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787190642.159204:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1787190642.159224:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190642.159227:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787190642.159676:0:17224:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787190642.159681:0:17224:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1787190642.159690:0:17224:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787190642.163263:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb410a 00000020:00000080:1.0:1787190642.163277:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f15eabc800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787190642.163682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15eabc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787190642.165727:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb411f 00000020:00000080:1.0:1787190642.165738:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f146d12800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787190642.165792:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1787190642.165798:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.165806:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787190642.165810:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99f17c3799b8) has no exports 00000004:01000000:1.0:1787190642.165982:0:20767:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1787190642.165991:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4181 00000020:00000080:1.0:1787190642.165996:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f1581c8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190642.166867:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f146d12800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787190642.170849:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787190642.171001:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.171014:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190642.171020:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99f1667acd28) has no exports 00000020:00000080:1.0:1787190642.171032:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb417a 00000020:00000080:1.0:1787190642.171042:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17d089800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787190642.171559:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787190642.171565:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787190642.171570:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1787190642.171591:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190642.171593:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787190642.171632:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.171639:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190642.171649:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb416c 00000020:00000080:1.0:1787190642.171654:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17d08c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787190642.171659:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1787190642.171662:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.171665:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190642.171668:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99f17006cd28) has no exports 00000020:00000080:1.0:1787190642.171672:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4165 00000020:00000080:1.0:1787190642.171675:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f148391000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787190642.171923:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1787190642.171926:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787190642.171928:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1787190642.171932:0:20767:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787190642.171933:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787190642.171954:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.171959:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1787190642.171971:0:20767:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1787190642.171978:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4157 00000020:00000080:1.0:1787190642.171982:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17016c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1787190642.171986:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1787190642.171989:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.171992:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190642.171995:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff99f17006b370) has no exports 00000020:00000080:1.0:1787190642.171999:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4150 00000020:00000080:1.0:1787190642.172001:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17016f000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1787190642.172260:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1787190642.172263:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1787190642.172265:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787190642.172269:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787190642.172326:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.172331:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190642.172365:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.172368:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190642.172371:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f15eab9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787190642.172374:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15eab9800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1787190642.172380:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190642.172476:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4126 00000020:00000080:1.0:1787190642.172481:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f146d15000/lustre-MDD0000_UUID 00000020:01000000:1.0:1787190642.172485:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1787190642.172488:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.172491:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787190642.172492:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99f17c37cd28) has no exports 00000020:00000080:1.0:1787190642.172509:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.172512:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1787190642.172515:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb412d 00000020:00000080:1.0:1787190642.172518:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f15eaba800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787190642.172526:0:20767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f17cfb0000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1787190642.172529:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f17cfb0000 3 00000020:01000004:1.0:1787190642.172532:0:20767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99f17cfb0000 from lustre-MDT0000 00000020:00000080:1.0:1787190642.172549:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190642.172552:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1787190642.172554:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f15eab8800/lustre-MDT0000_UUID 00000020:00000080:1.0:1787190642.172556:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15eab8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1787190642.172562:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1787190642.172591:0:20767:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1787190642.172595:0:20767:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1787190642.172597:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1787190642.172600:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190642.172602:0:20767:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787190642.172609:0:20767:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99f146dd0000 aaf1974a-df29-4cc0-91ca-96e33a5a3e1f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787190642.172613:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99f166408000) has exports, disconnecting them 00000020:00080000:1.0:1787190642.172622:0:20767:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99f146dd0000), last request at 1787190550 00000020:00000080:1.0:1787190642.172636:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb40d2 00000020:00010000:1.0:1787190642.172640:0:20767:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99f146dd0000: total 8 00000100:00080000:1.0:1787190642.172644:0:20767:0:(import.c:65:import_set_state_nolock()) ffff99f146dd3000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787190642.172670:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f146dd0000): rc 0 00000020:00080000:1.0:1787190642.172674:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99f166408000) has no exports 00000100:00100000:1.0:1787190642.172736:0:17191:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99f146db6400:17191] 0 exiting: rc = 1 00000020:00010000:1.0:1787190642.172834:0:17187:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99f146dd0000: total 8 00010000:00010000:1.0:1787190642.172859:0:17187:0:(ldlm_lock.c:2658:ldlm_export_cancel_blocked_locks()) Export ffff99f146dd0000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787190642.172890:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f182044600/0xdedcc04674eb43f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb43f0 expref: 14 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172908:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f182045000/0xdedcc04674eb4333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb432c expref: 13 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172921:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a7600/0xdedcc04674eb42ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb42a7 expref: 12 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172932:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158121c00/0xdedcc04674eb41ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb41f8 expref: 11 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172945:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17c56f800/0xdedcc04674eb43cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb43c6 expref: 10 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172956:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb467b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb4674 expref: 9 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172966:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158120000/0xdedcc04674eb45cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb45c5 expref: 8 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172978:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17c56f400/0xdedcc04674eb41f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb41ea expref: 7 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.172998:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a7c00/0xdedcc04674eb435d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb4356 expref: 6 pid: 17193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.173009:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb4682 expref: 5 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.173019:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039f200/0xdedcc04674eb4697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb4690 expref: 4 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.173029:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158121400/0xdedcc04674eb420d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb4206 expref: 3 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.173038:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a6c00/0xdedcc04674eb40e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdedcc04674eb40d9 expref: 2 pid: 17192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190642.173049:0:17187:0:(ldlm_lock.c:2686:ldlm_export_cancel_locks()) Export ffff99f146dd0000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1787190642.173063:0:17187:0:(genops.c:885:class_export_put()) final put ffff99f146dd0000/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f 00010000:00010000:1.0:1787190642.173069:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190642.173072:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190642.173074:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190642.173106:0:17192:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99f146db6c00:17192] 1 exiting: rc = 0 00000020:00000080:2.0:1787190642.173323:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1581c8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787190642.173334:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17d089800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190642.173340:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17d088800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787190642.173356:0:8:0:(genops.c:885:class_export_put()) final put ffff99f17d08c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190642.173358:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17d08c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787190642.173362:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787190642.173412:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17d08c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787190642.173417:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f148391000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190642.173422:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f146a4c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787190642.173426:0:8:0:(genops.c:885:class_export_put()) final put ffff99f17016e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190642.173428:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17016e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787190642.173438:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787190642.173469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17016c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787190642.173473:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17016f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190642.173478:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f15eabd000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1787190642.173481:0:8:0:(genops.c:885:class_export_put()) final put ffff99f170169800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190642.173483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f170169800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1787190642.173485:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787190642.173506:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f146d15000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787190642.173509:0:8:0:(genops.c:885:class_export_put()) final put ffff99f15eabe800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787190642.173511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15eabe800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787190642.173514:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787190642.173536:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15eaba800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190642.173541:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f146dd0000/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f for MGS 00000020:00000080:2.0:1787190642.173566:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f146dd3000 for MGS 00000100:00100000:0.0:1787190642.173691:0:17193:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99f146db7600:17193] 2 exiting: rc = 0 00000100:00100000:2.0:1787190642.174547:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174557:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174564:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174569:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174574:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174580:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174584:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174590:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174595:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174601:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174606:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174612:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174617:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174623:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174628:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174633:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174652:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174658:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174664:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174670:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174675:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174681:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174685:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174690:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174696:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174702:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174708:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174713:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174718:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174725:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174730:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174735:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174740:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174744:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174749:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174754:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174758:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174776:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174782:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174835:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174840:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174846:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174851:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174857:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174862:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174871:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174876:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174882:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174887:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174893:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174898:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174911:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174917:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174922:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174929:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174934:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174939:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174944:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174949:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174955:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174961:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174966:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174972:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190642.174977:0:20767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1787190642.188106:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f17c60b660 - data ffff99f170781798/ffff99f15e440800 00000020:01000000:2.0:1787190642.188254:0:20767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f148771900 - data ffff99f1704b6d80/ffff99f166692c00 00000020:00000080:2.0:1787190642.188843:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb40b6 00000020:00000080:2.0:1787190642.188853:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17cfb5800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787190642.189991:0:20767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f17cfb0000 from MGS, refs=2 00000020:01000004:2.0:1787190642.189999:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f17cfb0000 2 00000020:01000004:2.0:1787190642.190003:0:20767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99f17cfb0000 from MGS 00000020:00000080:2.0:1787190642.190036:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190642.190045:0:20767:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787190642.190049:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17cfb1800/MGS 00000020:00000080:2.0:1787190642.190052:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17cfb1800/MGS for MGS 00000020:01000000:2.0:1787190642.190059:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787190642.190127:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787190642.190132:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190642.190137:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787190642.190144:0:20767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99f17c43d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787190642.190151:0:20767:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff99f16640cd28) has exports, disconnecting them 00000020:00080000:2.0:1787190642.190156:0:20767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99f17c43d000), last request at 1787190550 00000020:00000080:2.0:1787190642.190160:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb41b9 00000020:00080000:2.0:1787190642.190181:0:20767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f17c43d000): rc 0 00000020:00000080:2.0:1787190642.190186:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17c43d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787190642.190272:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17cfb5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787190642.200542:0:20767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1787190642.200552:0:20767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190642.200558:0:20767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787190642.200565:0:20767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787190642.200700:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190642.200709:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1787190642.200716:0:20767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f17cfb0000 1 00000020:00000080:2.0:1787190642.200723:0:20767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb40a8 00000020:00000080:2.0:1787190642.200731:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17cfb2000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1787190642.200736:0:20767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1787190642.200741:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190642.200744:0:20767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787190642.200748:0:20767:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99f16640b370) has no exports 00000020:00000080:0.0:1787190642.209779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c43d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787190642.209796:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c439800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787190642.209805:0:37:0:(genops.c:885:class_export_put()) final put ffff99f17c43f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787190642.209808:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c43f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787190642.209812:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787190642.209892:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17cfb2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787190642.233664:0:20767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190642.233676:0:20767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787190642.233681:0:20767:0:(genops.c:885:class_export_put()) final put ffff99f17cfb7000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787190642.233685:0:20767:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17cfb7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787190642.233694:0:20767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787190642.233926:0:20767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99f17cfb2800 00000020:02000400:2.0:1787190642.233976:0:20767:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787190642.461699:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190643.476561:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190644.499382:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190645.522476:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190645.911568:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695809408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1787190645.911643:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190645.912170:0:18706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809408 00000100:00100000:1.0:1787190645.912188:0:18706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809408 00000100:00100000:1.0:1787190645.912252:0:18706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190645.912262:0:18706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695809408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787190645.912345:0:18706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787190645.912396:0:18706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695809408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 134us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190645.912412:0:18706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190645.912464:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695809408:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787190645.912692:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787190645.912991:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787190645.912995:0:18699:0:(genops.c:885:class_export_put()) final put ffff99f165eab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787190645.917040:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165eab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787190645.917111:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165eaa000 for lustre-OST0000 00000020:01000004:3.0:1787190646.512566:0:20968:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787190646.529116:0:20968:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1787190646.529174:0:20968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190646.529203:0:20968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190646.529212:0:20968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190646.529220:0:20968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190646.529243:0:20968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787190646.529247:0:20968:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787190646.529272:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190646.529276:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787190646.529282:0:20968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787190646.529327:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f15818f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787190646.529334:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190646.529335:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787190646.529354:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787190646.529487:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190646.529495:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529503:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f182044c00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190646.529507:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529527:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190646.529534:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190646.529541:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190646.529544:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787190646.529546:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787190646.529553:0:20968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529560:0:20968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529577:0:20968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529582:0:20968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529600:0:20968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190646.529606:0:20968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529606:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529612:0:20968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529617:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190646.529618:0:20968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529624:0:20968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529630:0:20968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787190646.529636:0:20968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529642:0:20968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529648:0:20968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529650:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529657:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f182044c00/0xdedcc04674eb42a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb42ae expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529664:0:20968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529669:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787190646.529671:0:20968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190646.529672:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529677:0:20968:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529678:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7400 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190646.529681:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529683:0:20968:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529688:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529690:0:20968:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190646.529696:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190646.529697:0:20968:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190646.529702:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190646.529703:0:20968:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787190646.529704:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1787190646.529706:0:20968:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1787190646.529708:0:20968:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1787190646.529713:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529718:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1787190646.529728:0:20968:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00010000:00010000:0.0:1787190646.529730:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:2.0:1787190646.529731:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1787190646.529735:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190646.529740:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00010000:00010000:0.0:1787190646.529745:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1700a7400/0xdedcc04674eb4206 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb420d expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787190646.529747:0:20968:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99f165e2d800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787190646.529753:0:20968:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff99f1776cd800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1787190646.529754:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787190646.529757:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787190646.529758:0:20968:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff99f17ccf99b8) has exports, disconnecting them 00010000:00010000:0.0:1787190646.529762:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4400 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190646.529766:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529772:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190646.529778:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190646.529783:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190646.529785:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1787190646.529787:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1787190646.529799:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529804:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190646.529810:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529818:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b4400/0xdedcc04674eb45c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb45cc expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529839:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190646.529842:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529848:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e600 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190646.529851:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190646.529853:0:17187:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190646.529858:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190646.529864:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190646.529869:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787190646.529872:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787190646.529873:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787190646.529887:0:17186:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190646.529891:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695809664:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190646.529892:0:17186:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190646.529898:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529904:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb4697 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190646.529911:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190646.529913:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190646.529919:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190646.529933:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695809920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190646.529972:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190646.530045:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190646.530050:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695809536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190646.530071:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190646.530094:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190646.530095:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3654:1874004695809792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190646.530099:0:17187:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190646.530105:0:17187:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6800 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190646.530108:0:17187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190646.530115:0:17187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190646.530115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1787190646.530121:0:17187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190646.530127:0:17187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190646.530129:0:17187:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787190646.530131:0:17187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1787190646.530142:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809920 00010000:00010000:1.0:1787190646.530143:0:17187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190646.530148:0:17187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787190646.530148:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809920 00010000:00010000:1.0:1787190646.530157:0:17187:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190646.530169:0:17187:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1700a6800/0xdedcc04674eb41f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdedcc04674eb41ff expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190646.530173:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809536 00000100:00100000:0.0:1787190646.530175:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809536 00010000:00010000:1.0:1787190646.530179:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190646.530181:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190646.530182:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190646.530182:0:17184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809792 00000100:00100000:0.0:1787190646.530184:0:17184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809792 00010000:00010000:1.0:1787190646.530187:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190646.530188:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190646.530195:0:17184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190646.530203:0:17184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1874004695809920:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787190646.530209:0:17184:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190646 with bad export cookie 16058921780138164434 00000020:00080000:2.0:1787190646.530353:0:20968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99f165e2d800), last request at 1787190641 00000020:00000080:2.0:1787190646.530360:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4421 00000100:00080000:2.0:1787190646.530382:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f165e2f800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787190646.530498:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190646.530522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695810048:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1787190646.530543:0:20968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f165e2d800): rc 0 00000020:00000080:2.0:1787190646.530546:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f165e2d800/lustre-MDT0001-lwp-OST0001_UUID 00000100:00100000:3.0:1787190646.530550:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787190646.530591:0:20968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff99f1776cd800), last request at 1787190641 00000020:00000080:2.0:1787190646.530595:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4387 00000100:00080000:2.0:1787190646.530602:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f1776ca000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787190646.530621:0:20968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f1776cd800): rc 0 00000020:00000080:2.0:1787190646.530624:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f1776cd800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:3.0:1787190646.530650:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787190646.534830:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165e2d800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1787190646.534911:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165e2f800 for lustre-MDT0001 00000100:00100000:1.0:1787190646.535526:0:17183:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787190646.535544:0:17183:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787190646.535688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000080:2.0:1787190646.535895:0:20968:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb85581cf7ae0 00000100:00080000:2.0:1787190646.535917:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190646.535927:0:20968:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff99f1483ff100 x1874004695807872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1787190657 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190646.535937:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787190646.535947:0:20968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787190646.535951:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f17c592800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1787190646.536215:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787190646.536219:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787190646.536235:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787190646.536240:0:20968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787190646.536261:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f166522800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787190646.536275:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787190646.536277:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1787190646.536316:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787190646.536330:0:20968:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787190646.536364:0:20968:0:(import.c:65:import_set_state_nolock()) ffff99f17c689800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787190646.536549:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695810176:0@lo:9:umount.0 00000100:00100000:3.0:1787190646.536617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190646.536642:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695810304:0@lo:9:umount.0 00000100:00100000:3.0:1787190646.536662:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190646.536696:0:19231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695810176 00000100:00100000:3.0:1787190646.536706:0:19231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695810176 00000100:00100000:3.0:1787190646.536749:0:19231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695810304 00000100:00100000:3.0:1787190646.536752:0:19231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695810304 00000100:00100000:3.0:1787190646.536795:0:19231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787190646.536804:0:19231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874004695810176:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787190646.536832:0:19231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb43b1 00000100:00080000:3.0:1787190646.536843:0:19231:0:(import.c:65:import_set_state_nolock()) ffff99f1776cf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190646.536891:0:19231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1787190646.537024:0:19231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3650:x1874004695810176:12345-0@lo:9:umount.0 Request processed in 221us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190646.537031:0:19231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787190646.537046:0:19231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787190646.537052:0:19231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1874004695810304:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787190646.537062:0:19231:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4444 00000100:00080000:3.0:1787190646.537067:0:19231:0:(import.c:65:import_set_state_nolock()) ffff99f165edc800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787190646.537088:0:19231:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1787190646.537159:0:19231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3650:x1874004695810304:12345-0@lo:9:umount.0 Request processed in 107us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190646.537176:0:19231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787190646.537198:0:17194:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190646.537230:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f166522800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787190646.537238:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787190646.537241:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787190646.537244:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695810176:0@lo:9:umount.0 00000100:00080000:3.0:1787190646.537254:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c689800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787190646.537261:0:3650:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787190646.537263:0:3650:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787190646.537265:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695810304:0@lo:9:umount.0 00010000:00010000:3.0:1787190646.537324:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787190646.537595:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff99f17ccf99b8) has no exports 00000020:00000080:1.0:1787190646.540603:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1776cd800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1787190646.540659:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f1776ca000 for lustre-MDT0001 00010000:00010000:1.0:1787190646.540673:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190646.541399:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787190646.541683:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695810048 00000100:00100000:1.0:1787190646.541692:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695810048 00000100:00100000:1.0:1787190646.541726:0:17185:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787190646.541731:0:17185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695809664 00000100:00100000:1.0:1787190646.541734:0:17185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695809664 00000100:00100000:1.0:1787190646.541774:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695807872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190646.543686:0:20970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190646.543698:0:20970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1874004695809536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787190646.543707:0:20970:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190646 with bad export cookie 16058921780138164434 00000100:00100000:1.0:1787190646.543811:0:20970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3651:x1874004695809536:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (13737us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190646.543833:0:20970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190646.543854:0:20970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190646.543859:0:20970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874004695809792:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787190646.543992:0:20970:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190646 with bad export cookie 16058921780138164434 00000100:00100000:1.0:1787190646.544035:0:20970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3654:x1874004695809792:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (13919us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190646.544042:0:20970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190646.544056:0:20970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190646.544060:0:20970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874004695810048:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787190646.544064:0:20970:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190646 with bad export cookie 16058921780138164434 00000100:00100000:1.0:1787190646.544095:0:20970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3652:x1874004695810048:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (13543us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190646.544101:0:20970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190646.544114:0:20970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190646.544119:0:20970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c0d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3653:x1874004695809664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787190646.544123:0:20970:0:(ldlm_lockd.c:2580:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787190646 with bad export cookie 16058921780138164434 00000100:00100000:1.0:1787190646.544151:0:20970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c0d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3653:x1874004695809664:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (8465us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787190646.544157:0:20970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787190646.544191:0:3653:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787190646.544195:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f144dc5000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787190646.544199:0:3653:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1787190646.544254:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787190646.557796:0:3654:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1787190646.566740:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787190646.573610:0:3653:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.122@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787190646.573616:0:3653:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787190646.573625:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fc700 x1874004695809664/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190646.573654:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fe680 x1874004695809920/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190646.573664:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483ffb80 x1874004695809536/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190646.573673:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fc380 x1874004695809792/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190646.573681:0:3653:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffaad80 x1874004695810048/t0(0) o103->MGC192.168.202.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787190646.575547:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787190646.575555:0:3653:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787190646.575556:0:3653:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787190646.576013:0:3651:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99f144dc5000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787190646.576168:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695809920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190646.576199:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3651:1874004695809536:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787190646.581252:0:3654:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99f144dc5000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787190646.581298:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3654:1874004695809792:0@lo:103:ldlm_bl.0 00000400:00000100:0.0:1787190646.581831:0:17184:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874004695809920 offset 224 length 224: 4 00000100:00100000:0.0:1787190646.581852:0:17184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3651:x1874004695809920:12345-0@lo:103:ldlm_bl.0 Request processed in 51648us (51879us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787190646.581861:0:17184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787190646.582237:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787190646.592624:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff99f144dc5000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1787190646.599227:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3652:1874004695810048:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787190646.599411:0:3653:0:(import.c:65:import_set_state_nolock()) ffff99f144dc5000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190646.599418:0:3653:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 527 00000100:00080000:1.0:1787190646.599427:0:3653:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff99f144dc5000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190646.599503:0:3653:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483ff480 x1874004695810432/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190646.599548:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3653:1874004695809664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190646.599571:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3650:1874004695810432:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1787190646.599750:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874004695810432 offset 0 length 520: 4 00000020:00080000:2.0:1787190646.625665:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff99f17ccf99b8) has no exports 00000020:01000000:2.0:1787190646.625870:0:20968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f15ff0e480 - data ffff99f16063be58/ffff99f165f76c00 00000020:01000000:2.0:1787190646.626042:0:20968:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f158dcfc00 - data ffff99f170473e58/ffff99f17c099800 00000001:00000004:2.0:1787190646.642636:0:20968:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1787190646.673032:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190646.673041:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787190646.673048:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1787190646.679687:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787190646.679698:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787190646.679718:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190646.679721:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787190646.680802:0:17939:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787190646.680807:0:17939:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1787190646.680828:0:17939:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1787190646.681586:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787190646.681592:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1787190646.681604:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190646.681606:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787190646.682030:0:17941:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787190646.682034:0:17941:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1787190646.682042:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1787190646.686028:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb421b 00000020:00000080:1.0:1787190646.686041:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f15ff4e800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787190646.686570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff4e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1787190646.686889:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4230 00000020:00000080:0.0:1787190646.686896:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f150b1e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787190646.686909:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1787190646.686915:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.686923:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787190646.686928:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99f1664099b8) has no exports 00000004:01000000:0.0:1787190646.687079:0:20968:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787190646.687087:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4284 00000020:00000080:0.0:1787190646.687092:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f15818d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787190646.687095:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787190646.687099:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.687103:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787190646.687105:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff99f17ccfb370) has no exports 00000020:00000080:0.0:1787190646.687110:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb427d 00000020:00000080:0.0:1787190646.687113:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c68d800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787190646.687656:0:20968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787190646.687661:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787190646.687676:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787190646.687682:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190646.687685:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190646.687711:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.687718:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787190646.687722:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb426f 00000020:00000080:0.0:1787190646.687727:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c688000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787190646.687731:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1787190646.687734:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.687738:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787190646.687740:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99f17c134d28) has no exports 00000020:00000080:0.0:1787190646.687744:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4268 00000020:00000080:0.0:1787190646.687746:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c590800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787190646.688053:0:20968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1787190646.688056:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787190646.688058:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:0.0:1787190646.688061:0:20968:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787190646.688063:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190646.688083:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.688088:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1787190646.688096:0:20968:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1787190646.688101:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4253 00000020:00000080:0.0:1787190646.688105:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c590000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1787190646.688109:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1787190646.688112:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.688115:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787190646.688117:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff99f17ccfcd28) has no exports 00000020:00000080:0.0:1787190646.688121:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb424c 00000020:00000080:0.0:1787190646.688123:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c595800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1787190646.688363:0:20968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1787190646.688366:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190646.688368:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787190646.688377:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190646.688400:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.688404:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787190646.690547:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.690558:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1787190646.690583:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4237 00000020:00000080:0.0:1787190646.690592:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f150b19800/lustre-MDD0001_UUID 00000020:01000000:0.0:1787190646.690600:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1787190646.690604:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.690608:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787190646.690611:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99f17ccf8000) has no exports 00000020:00000080:0.0:1787190646.690628:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.690631:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1787190646.690635:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb423e 00000020:00000080:0.0:1787190646.690638:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f150b18800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1787190646.690645:0:20968:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f1551ad800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1787190646.690648:0:20968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1551ad800 2 00000020:01000004:0.0:1787190646.690651:0:20968:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99f1551ad800 from lustre-MDT0001 00000020:00000080:0.0:1787190646.690666:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190646.690670:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1787190646.690672:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f15ff4b800/lustre-MDT0001_UUID 00000020:00000080:0.0:1787190646.690675:0:20968:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff4b800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1787190646.690685:0:20968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1787190646.690773:0:20968:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1787190646.690777:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1787190646.690781:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190646.690785:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787190646.690793:0:20968:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff99f17c43f800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190646.690799:0:20968:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff99f1794bb370) has exports, disconnecting them 00000020:00080000:0.0:1787190646.690804:0:20968:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff99f17c43f800), last request at 1787190564 00000020:00000080:0.0:1787190646.690808:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb42bc 00000020:00080000:0.0:1787190646.690834:0:20968:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f17c43f800): rc 0 00000020:00000080:0.0:1787190646.690837:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f17c43f800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787190646.691459:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f150b1e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1787190646.691467:0:8:0:(genops.c:885:class_export_put()) final put ffff99f15ff4d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787190646.691469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff4d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1787190646.691478:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190646.691636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15818d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787190646.691657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c68d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787190646.691667:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c689800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1787190646.691674:0:8:0:(genops.c:885:class_export_put()) final put ffff99f17c68e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787190646.691676:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c68e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1787190646.691682:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190646.691723:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c688000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1787190646.691732:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c590800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1787190646.691735:0:20968:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000020:00000080:3.0:1787190646.691738:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f166522800 for lustre-OST0000-osc-MDT0001 00000100:00080000:1.0:1787190646.691741:0:20968:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787190646.691747:0:20968:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000020:00000080:3.0:1787190646.691751:0:8:0:(genops.c:885:class_export_put()) final put ffff99f17c59a800/lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1787190646.691754:0:20968:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787190646.691755:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c59a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1787190646.691760:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190646.691814:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c590000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787190646.691824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c595800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787190646.691833:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f17c592800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1787190646.691838:0:8:0:(genops.c:885:class_export_put()) final put ffff99f17c591800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787190646.691840:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c591800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1787190646.691846:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190646.691951:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f150b19800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1787190646.691957:0:8:0:(genops.c:885:class_export_put()) final put ffff99f146dd6000/lustre-MDD0001_UUID 00000020:00000080:3.0:1787190646.691959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f146dd6000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1787190646.691963:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1787190646.691989:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787190646.691996:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1787190646.692002:0:20968:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1551ad800 1 00000020:00000080:1.0:1787190646.692007:0:20968:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb41e3 00000020:00000080:1.0:1787190646.692011:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f14842d800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1787190646.692016:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1787190646.692025:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787190646.692028:0:20968:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787190646.692031:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff99f1700699b8) has no exports 00000020:00000080:3.0:1787190646.692098:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f150b18800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1787190646.692105:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c43f800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787190646.692112:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f15818f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1787190646.692118:0:8:0:(genops.c:885:class_export_put()) final put ffff99f15818e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1787190646.692121:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15818e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1787190646.692124:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1787190646.692159:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f14842d800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1787190646.766162:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190646.766178:0:20968:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1787190646.766183:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f14842e800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1787190646.766188:0:20968:0:(genops.c:844:class_export_destroy()) destroying export ffff99f14842e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1787190646.766200:0:20968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1787190646.766354:0:20968:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99f17c724800 00000020:01000000:2.0:1787190646.766373:0:20968:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787190646.766378:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190646.766382:0:20968:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787190646.766386:0:20968:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99f170068000) has no exports 00000100:00100000:2.0:1787190646.766458:0:19230:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99f1458fc800:19230] 3 exiting: rc = 0 00000100:00100000:3.0:1787190646.766783:0:17200:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99f1444a7e00:17200] 2 exiting: rc = 0 00000100:00100000:1.0:1787190646.767148:0:17199:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99f1444a6400:17199] 1 exiting: rc = 0 00000100:00100000:3.0:1787190646.767252:0:17197:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99f1444a6e00:17197] 0 exiting: rc = 1 00000100:00100000:2.0:1787190646.767384:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767391:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767397:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767413:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767419:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767436:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767441:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767447:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767452:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767457:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767463:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767468:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767474:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767478:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767483:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767488:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767493:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767499:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767504:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767509:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767514:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767520:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767525:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767529:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767535:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767540:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767545:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767551:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767556:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767562:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767567:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767573:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767578:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767583:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767588:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767593:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767598:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767603:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767609:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767614:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767629:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767634:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767640:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767645:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767651:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767656:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767661:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767667:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767672:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767678:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767683:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767688:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767693:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767697:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767702:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767708:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767713:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767719:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767725:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767730:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767735:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767741:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767747:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.767752:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190646.775051:0:17202:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99f1444a7600:17202] 1 exiting: rc = 0 00000100:00100000:0.0:1787190646.775199:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99f14846e600:17201] 0 exiting: rc = 1 00000100:00100000:2.0:1787190646.782487:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782499:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782505:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782510:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782515:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782521:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782526:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782530:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782535:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782539:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782544:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782562:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782567:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782572:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782577:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782581:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782586:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782590:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782596:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782601:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782606:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782611:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782617:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782622:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782627:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782631:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782636:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782641:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782645:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782650:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782655:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782660:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782664:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782669:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782674:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782678:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782683:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782687:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782692:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782697:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782702:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782707:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782712:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782717:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782749:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782755:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782777:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782782:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782787:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782792:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782797:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782802:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782808:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782813:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782818:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782823:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782828:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782833:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782838:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782842:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782847:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782851:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782856:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.782861:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.783382:0:19861:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff99f15e4ebc00:19861] 2 exiting: rc = 0 00000100:00100000:2.0:1787190646.783477:0:17203:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99f17ce6b200:17203] 0 exiting: rc = 1 00000100:00100000:1.0:1787190646.783913:0:17204:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99f1446bb200:17204] 1 exiting: rc = 0 00000100:00100000:2.0:1787190646.786562:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786573:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786578:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786586:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786592:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786598:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786608:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786614:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786620:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786625:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786631:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786637:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786643:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786648:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786654:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786698:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786706:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786712:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786718:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786725:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786730:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786736:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786742:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786748:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.786754:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.788982:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.788998:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789028:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789035:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789041:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789047:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789055:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789060:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789066:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789072:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789080:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789086:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789091:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789097:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789119:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789126:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789132:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789138:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789144:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789150:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789156:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789162:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789167:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789172:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789177:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789195:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789214:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789221:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789227:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789233:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789239:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789245:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789250:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789256:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789261:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789267:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789273:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789278:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.789647:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.806928:0:17205:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99f17ce6a600:17205] 0 exiting: rc = 1 00000100:00100000:2.0:1787190646.807133:0:17206:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99f1446bac00:17206] 1 exiting: rc = 0 00000100:00100000:3.0:1787190646.807510:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807519:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807524:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807529:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807534:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807540:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807558:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807564:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807569:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807573:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807578:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807583:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807589:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807594:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807599:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807604:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807610:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807615:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807620:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807625:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807631:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807637:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807641:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807646:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807651:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807656:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807660:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807665:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807670:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807675:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807679:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807684:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807689:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807694:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807698:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807705:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807709:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807714:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807719:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807724:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807728:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807740:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807745:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807750:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807755:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.807871:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808566:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808573:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808578:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808583:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808588:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808594:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808599:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808604:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808609:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808614:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808618:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808623:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808628:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808632:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808637:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808642:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808648:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.808653:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.809114:0:17208:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99f1667bda00:17208] 1 exiting: rc = 0 00000100:00100000:3.0:1787190646.811434:0:17207:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99f14868f600:17207] 0 exiting: rc = 1 00000100:00100000:0.0:1787190646.811644:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811658:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811664:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811669:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811675:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811680:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811685:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811690:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811702:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811709:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811714:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811720:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811731:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811736:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811741:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811746:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811757:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811763:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811768:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811773:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811778:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811782:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811794:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811800:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811805:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811810:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811814:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811826:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811831:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811860:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811866:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811871:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811876:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811881:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811892:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811898:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811903:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811908:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811913:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811925:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811931:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811935:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811941:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811947:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811951:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811956:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811967:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811973:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811978:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811982:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811986:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.811996:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812002:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812006:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812011:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812016:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812026:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812031:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812036:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812040:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812045:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812056:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812061:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.812065:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.813599:0:17209:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99f14868fa00:17209] 0 exiting: rc = 1 00000100:00100000:1.0:1787190646.816600:0:17210:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99f1667bcc00:17210] 1 exiting: rc = 0 00000100:00100000:0.0:1787190646.816800:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816808:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816813:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816819:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816825:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816831:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816836:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816841:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816846:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816851:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816857:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816862:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816867:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816872:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816893:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816899:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816905:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816910:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816922:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816926:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816931:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816936:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816941:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816946:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816951:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816962:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816968:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816972:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816977:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816982:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816988:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816992:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.816997:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817002:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817008:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817026:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817031:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817037:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817042:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817047:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817052:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817057:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817061:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817065:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817070:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817074:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817079:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817083:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817088:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817092:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817097:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817101:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817105:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817110:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817114:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817118:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817123:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817127:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817132:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817136:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817140:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817145:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817150:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190646.817155:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190646.817786:0:17211:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99f15ea79600:17211] 0 exiting: rc = 1 00000100:00100000:1.0:1787190646.818124:0:17212:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99f15ea79e00:17212] 1 exiting: rc = 0 00000100:00100000:1.0:1787190646.818320:0:17213:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99f17039aa00:17213] 2 exiting: rc = 0 00000100:00100000:2.0:1787190646.819415:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819424:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819430:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819445:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819453:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819460:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819466:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819472:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819478:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819484:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819490:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819496:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819502:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819508:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819513:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819519:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819524:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819530:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819534:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819540:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819566:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819572:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819576:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819581:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819587:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819592:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819598:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819604:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819611:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819617:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819623:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819629:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819634:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819640:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819646:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819652:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819659:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819664:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819669:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819675:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819681:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819686:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819692:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819697:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819716:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819722:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819728:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819734:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819740:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819746:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819752:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819770:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819778:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819784:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819790:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819802:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819809:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819814:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819819:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819825:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819831:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819836:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819842:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190646.819847:0:20968:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787190646.833421:0:20968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190646.833435:0:20968:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1787190646.833441:0:20968:0:(genops.c:885:class_export_put()) final put ffff99f144dc3800/MDS_uuid 00000020:00000080:2.0:1787190646.833446:0:20968:0:(genops.c:844:class_export_destroy()) destroying export ffff99f144dc3800/MDS_uuid for MDS 00000020:01000000:2.0:1787190646.833458:0:20968:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1787190646.833618:0:20968:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1787190646.932483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787190646.932493:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190646.932497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787190646.932500:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787190646.932511:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f165d41800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190646.932519:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 618 00000100:00080000:0.0:1787190646.932525:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787190646.932533:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99f165d41800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190646.932570:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fc700 x1874004695810560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787190646.932632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787190646.932636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787190646.932637:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190646.932641:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 619 00000100:00080000:0.0:1787190646.932644:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787190646.932647:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99f165edf800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190646.932658:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fea00 x1874004695810816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190646.932697:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874004695810688:0@lo:400:kworker.0 00000400:00000100:0.0:1787190646.932748:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695810688 offset 0 length 224: 4 00000100:00100000:1.0:1787190646.932866:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695810560:0@lo:38:kworker.0 00000400:00000100:1.0:1787190646.942661:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695810560 offset 0 length 520: 4 00000100:00100000:1.0:1787190646.942705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695810816:0@lo:38:kworker.0 00000400:00000100:1.0:1787190646.942741:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695810816 offset 0 length 520: 4 00000100:00100000:1.0:1787190646.944238:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695810944:0@lo:400:kworker.0 00000400:00000100:1.0:1787190646.944311:0:3654:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695810944 offset 0 length 224: 4 00010000:00010000:2.0:1787190647.635409:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190648.659488:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190649.684717:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787190650.695912:0:21171:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787190650.704725:0:21171:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1787190650.704791:0:21171:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190650.704807:0:21171:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190650.704814:0:21171:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190650.704821:0:21171:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190650.704904:0:21171:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787190650.704910:0:21171:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787190650.704932:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190650.704945:0:21171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fc700 x1874004695810560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190661 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190650.704965:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787190650.704971:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787190650.704994:0:21171:0:(import.c:65:import_set_state_nolock()) ffff99f165d41800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787190650.705000:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190650.705004:0:21171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fc700 x1874004695810560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190661 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190650.705011:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787190650.705015:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00010000:00010000:0.0:1787190650.705351:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190650.705359:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190650.705367:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6000 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190650.705371:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190650.705379:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190650.705382:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695810560:0@lo:38:kworker.0 10000000:00010000:0.0:1787190650.705392:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190650.705398:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190650.705401:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787190650.705408:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787190650.705422:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:0.0:1787190650.705426:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190650.705433:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1700a6000/0xdedcc04674eb4356 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb435d expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190650.705459:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190650.705461:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190650.705463:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190650.707028:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787190650.707637:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787190650.707650:0:21171:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1483fce00 x1874004695810688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190662 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190650.707673:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787190650.707679:0:21171:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1787190650.707704:0:21171:0:(import.c:65:import_set_state_nolock()) ffff99f165d46000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787190650.707770:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874004695810688:0@lo:400:kworker.0 00000100:00100000:1.0:1787190650.709582:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874004695811072:0@lo:39:umount.0 00000400:00000100:1.0:1787190650.709638:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811072 offset 0 length 224: 4 00000100:00080000:1.0:1787190650.963602:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190650.963613:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190650.963616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190650.963619:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787190650.963775:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874004695811200:0@lo:400:kworker.0 00000400:00000100:2.0:1787190650.963839:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811200 offset 0 length 224: 4 00010000:00010000:2.0:1787190651.732753:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787190651.986418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190651.986428:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190651.986431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190651.986434:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787190651.986566:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190651.986587:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874004695811328:0@lo:400:kworker.0 00000400:00000100:2.0:1787190651.986640:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811328 offset 0 length 224: 4 00000001:00100000:2.0:1787190652.565472:0:19518:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1787190652.565482:0:19518:0:(genops.c:885:class_export_put()) final put ffff99f165eda000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787190652.565624:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165eda000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787190652.565674:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165edc800 for lustre-OST0001 00000001:00100000:3.0:1787190652.566179:0:18699:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1787190652.566183:0:18699:0:(genops.c:885:class_export_put()) final put ffff99f165ea9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1787190652.566259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165ea9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787190652.566328:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f1776cf000 for lustre-OST0000 00010000:00010000:2.0:1787190652.754667:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190653.780811:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190654.803791:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190655.827183:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190656.850687:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190656.850780:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190646/real 1787190646] req@ffff99f1483ff480 x1874004695810432/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787190656 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190656.850813:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f1483ff480 x1874004695810432/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787190656 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787190656.850832:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f144dc5000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190656.850848:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787190656.850853:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3650:1874004695810432:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1787190656.850986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787190656.850991:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787190656.850999:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f144dc5000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190656.851003:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1787190656.851008:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787190656.851013:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff99f144dc5000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190656.851042:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cfb80 x1874004695811456/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190656.851078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787190656.851082:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787190656.852026:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695811584:0@lo:400:kworker.0 00000400:00000100:3.0:1787190656.852085:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811584 offset 0 length 224: 4 00000100:00100000:0.0:1787190656.852225:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3650:1874004695811456:0@lo:250:kworker.0 00000400:00000100:0.0:1787190656.852251:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874004695811456 offset 0 length 520: 4 00010000:00010000:2.0:1787190657.876154:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190658.898521:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190659.922579:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190660.948344:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190650/real 1787190650] req@ffff99f17cdf7b80 x1874004695811072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787190660 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190660.948380:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17cdf7b80 x1874004695811072/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787190660 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787190660.948411:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f165d46000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787190660.948429:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874004695811072:0@lo:39:umount.0 00000100:00080000:3.0:1787190660.948925:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787190660.948930:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787190660.948935:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787190660.949024:0:21171:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949062:0:21171:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949070:0:21171:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949076:0:21171:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949104:0:21171:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190660.949112:0:21171:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949119:0:21171:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949132:0:21171:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949137:0:21171:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190660.949160:0:21171:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787190660.949165:0:21171:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787190660.949200:0:21171:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787190660.949204:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787190660.949209:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190660.949215:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787190660.949219:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99f17c1319b8) has no exports 00000020:00080000:3.0:1787190660.949247:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff99f17c1319b8) has no exports 00000020:01000000:3.0:1787190660.949316:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f1522b55a0 - data ffff99f1705bd000/ffff99f165e1b400 00000020:01000000:3.0:1787190660.949455:0:21171:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f158dcf900 - data ffff99f170575000/ffff99f165e6a400 00010000:00010000:0.0:1787190660.950189:0:20969:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190660.950198:0:20969:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950207:0:20969:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121e00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190660.950212:0:20969:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950221:0:20969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190660.950229:0:20969:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190660.950234:0:20969:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190660.950237:0:20969:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787190660.950240:0:20969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787190660.950256:0:20969:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:0.0:1787190660.950260:0:20969:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950266:0:20969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f158121e00/0xdedcc04674eb432c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb4333 expref: -99 pid: 18698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950277:0:20969:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190660.950281:0:20969:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950311:0:20969:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e800 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190660.950315:0:20969:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950332:0:20969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190660.950338:0:20969:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190660.950343:0:20969:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787190660.950346:0:20969:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787190660.950348:0:20969:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787190660.950354:0:20969:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:0.0:1787190660.950357:0:20969:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950364:0:20969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039e800/0xdedcc04674eb4682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb4689 expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190660.950373:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190660.950374:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190660.950376:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190660.951016:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190660.951268:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787190660.961019:0:21171:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787190660.984654:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4341 00000020:00000080:0.0:1787190660.984667:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f1510a0800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787190660.984686:0:21171:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f1587c0800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787190660.984690:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1587c0800 2 00000020:01000004:0.0:1787190660.984694:0:21171:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99f1587c0800 from lustre-OST0000 00000020:00000080:0.0:1787190660.984736:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190660.984746:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787190660.984750:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f17c439000/lustre-OST0000_UUID 00000020:00000080:0.0:1787190660.984753:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c439000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787190660.984760:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787190660.984830:0:21171:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787190660.984835:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787190660.984838:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190660.984844:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787190660.984851:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99f1776cb000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190660.984857:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff99f165e799b8) has exports, disconnecting them 00000020:00080000:0.0:1787190660.984862:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99f1776cb000), last request at 1787190580 00000020:00000080:0.0:1787190660.984866:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb436b 00000020:00080000:0.0:1787190660.984874:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f1776cb000): rc 0 00000020:00000080:0.0:1787190660.984879:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f1776cb000/lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787190660.985021:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787190660.985025:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787190660.985036:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787190660.985041:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190660.985442:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190660.985447:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1787190660.985451:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787190660.985455:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190660.985457:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787190660.985461:0:21171:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff99f165ead800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787190660.985466:0:21171:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff99f165e78000) has exports, disconnecting them 00000020:00080000:0.0:1787190660.985469:0:21171:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff99f165ead800), last request at 1787190580 00000020:00000080:0.0:1787190660.985472:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4380 00000020:00080000:0.0:1787190660.985478:0:21171:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f165ead800): rc 0 00000020:00000080:0.0:1787190660.985480:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f165ead800/lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1787190660.985624:0:21171:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787190660.985629:0:21171:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1787190660.985631:0:21171:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787190660.985634:0:21171:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787190660.985812:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190660.985817:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1787190660.985821:0:21171:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1587c0800 1 00000020:00000080:0.0:1787190660.985825:0:21171:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb431e 00000020:00000080:0.0:1787190660.985829:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f15ff48000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787190660.985833:0:21171:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787190660.985835:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190660.985837:0:21171:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787190660.985839:0:21171:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff99f17c133370) has no exports 00000020:00000080:3.0:1787190660.987311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1510a0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787190660.987330:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1776cb000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787190660.987336:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165d41800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787190660.987344:0:37:0:(genops.c:885:class_export_put()) final put ffff99f165d43800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787190660.987346:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d43800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787190660.987350:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787190660.987414:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165ead800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787190660.987419:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165d46000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1787190660.987422:0:37:0:(genops.c:885:class_export_put()) final put ffff99f165d40800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1787190660.987423:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d40800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1787190660.987427:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1787190660.987443:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff48000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787190661.051074:0:21171:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190661.051089:0:21171:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787190661.051095:0:21171:0:(genops.c:885:class_export_put()) final put ffff99f1587c6800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787190661.051099:0:21171:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1587c6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787190661.051110:0:21171:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787190661.051711:0:21171:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99f1587c5800 00000020:02000400:2.0:1787190661.051891:0:21171:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:2.0:1787190661.970917:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190646/real 1787190646] req@ffff99f1483fea00 x1874004695810816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787190661 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190661.970951:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f1483fea00 x1874004695810816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1787190661 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787190661.970971:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190661.970993:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787190661.970998:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695810816:0@lo:38:kworker.0 00010000:00010000:3.0:1787190661.971063:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787190661.971246:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190661.971253:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190661.971255:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787190661.971258:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787190661.971261:0:36:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190661.971266:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 624 00000100:00080000:1.0:1787190661.971272:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787190661.971335:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99f165edf800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190661.971366:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffab100 x1874004695811712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190661.971418:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190661.971430:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695811840:0@lo:400:kworker.0 00000400:00000100:1.0:1787190661.971476:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811840 offset 0 length 224: 4 00000100:00100000:2.0:1787190661.971972:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695811712:0@lo:38:kworker.0 00000400:00000100:2.0:1787190661.972003:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811712 offset 0 length 520: 4 00000100:00000400:1.0:1787190662.082811:0:3654:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190646/real 1787190646] req@ffff99f1483fc380 x1874004695810944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787190662 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190662.148515:0:3654:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff99f1483fc380 x1874004695810944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787190662 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787190662.148529:0:3654:0:(import.c:65:import_set_state_nolock()) ffff99f165eae800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1787190662.148533:0:3654:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1787190662.178385:0:3654:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:3.0:1787190662.178485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787190662.178492:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787190662.178495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787190662.178498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1787190662.178502:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f165eae800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787190662.178511:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 571 00000100:00080000:3.0:1787190662.178520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99f165eae800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190662.178561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf7480 x1874004695811968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787190662.178638:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695810944:0@lo:400:kworker.0 00000100:00100000:1.0:1787190662.178729:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874004695811968:0@lo:38:kworker.0 00000400:00000100:1.0:1787190662.178785:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874004695811968 offset 0 length 520: 4 00010000:00010000:1.0:1787190662.994629:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190664.018738:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190665.042486:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787190665.360569:0:21374:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787190665.381186:0:21374:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1787190665.381278:0:21374:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.381526:0:21374:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.381535:0:21374:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.381542:0:21374:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.381594:0:21374:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787190665.381600:0:21374:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787190665.381635:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190665.381646:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffab100 x1874004695811712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.381673:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787190665.381681:0:21374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787190665.381688:0:21374:0:(import.c:65:import_set_state_nolock()) ffff99f165edf800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787190665.381692:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787190665.381697:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffab100 x1874004695811712/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190681 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.381703:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787190665.381706:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:3.0:1787190665.381841:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695811712:0@lo:38:kworker.0 00000100:00080000:2.0:1787190665.381964:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787190665.381984:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa9500 x1874004695811200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190666 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382006:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa8700 x1874004695811328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190667 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382013:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1666cd880 x1874004695811584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382030:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa9880 x1874004695811840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382038:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f17cdf7480 x1874004695811968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190672 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382047:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787190665.382050:0:21374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787190665.382053:0:21374:0:(import.c:65:import_set_state_nolock()) ffff99f165eae800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1787190665.382056:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1787190665.382059:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa9500 x1874004695811200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190666 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382066:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa8700 x1874004695811328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190667 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382073:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1666cd880 x1874004695811584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190672 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190665.382435:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695811840:0@lo:400:kworker.0 00000100:00100000:2.0:1787190665.382475:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f15ffa9880 x1874004695811840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190677 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382485:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f17cdf7480 x1874004695811968/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787190672 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190665.382490:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:1.0:1787190665.382583:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190665.382590:0:17186:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190665.382598:0:17186:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56ec00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190665.382613:0:17186:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190665.382624:0:17186:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190665.382632:0:17186:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190665.382637:0:17186:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787190665.382639:0:17186:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787190665.382641:0:17186:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787190665.382654:0:17186:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:1.0:1787190665.382658:0:17186:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190665.382663:0:17186:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17c56ec00/0xdedcc04674eb43f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb43f7 expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190665.382674:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190665.382676:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190665.382678:0:17186:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190665.382737:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874004695811328:0@lo:400:kworker.0 00000100:00100000:0.0:1787190665.382836:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695811584:0@lo:400:kworker.0 00000100:00100000:2.0:1787190665.382922:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787190665.382966:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3651:1874004695811200:0@lo:400:kworker.0 00000100:00100000:3.0:1787190665.382991:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874004695811968:0@lo:38:kworker.0 00010000:00010000:2.0:1787190665.383179:0:21374:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383197:0:21374:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383203:0:21374:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383209:0:21374:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383230:0:21374:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190665.383237:0:21374:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383244:0:21374:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383250:0:21374:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383257:0:21374:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.383403:0:21374:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787190665.383409:0:21374:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787190665.383431:0:21374:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787190665.383434:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787190665.383439:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190665.383444:0:21374:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787190665.383448:0:21374:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99f1667ab370) has no exports 00000020:00080000:2.0:1787190665.383475:0:21374:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff99f1667ab370) has no exports 00000020:01000000:2.0:1787190665.383514:0:21374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f1522b58a0 - data ffff99f1705bf510/ffff99f165f56800 00000020:01000000:2.0:1787190665.383663:0:21374:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99f17c60be40 - data ffff99f151ab45e8/ffff99f15e443c00 00010000:00010000:0.0:1787190665.384367:0:20969:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190665.384375:0:20969:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384385:0:20969:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6200 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190665.384388:0:20969:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384398:0:20969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190665.384406:0:20969:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190665.384411:0:20969:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787190665.384413:0:20969:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787190665.384415:0:20969:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787190665.384428:0:20969:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:0.0:1787190665.384431:0:20969:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384447:0:20969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1700a6200/0xdedcc04674eb43c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb43cd expref: -99 pid: 19517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384458:0:20969:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190665.384461:0:20969:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384467:0:20969:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e000 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190665.384470:0:20969:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384476:0:20969:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190665.384482:0:20969:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190665.384488:0:20969:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787190665.384490:0:20969:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787190665.384492:0:20969:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787190665.384498:0:20969:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:0.0:1787190665.384501:0:20969:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384507:0:20969:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039e000/0xdedcc04674eb4674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb467b expref: -99 pid: 17195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190665.384518:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190665.384519:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190665.384526:0:20969:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190665.384766:0:17187:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1787190665.392545:0:21374:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787190665.399282:0:21374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb43db 00000020:00000080:2.0:1787190665.399950:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f165d81000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787190665.400026:0:21374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f1776cc800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787190665.400031:0:21374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1776cc800 2 00000020:01000004:2.0:1787190665.400035:0:21374:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99f1776cc800 from lustre-OST0001 00000020:00000080:2.0:1787190665.400067:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787190665.400077:0:21374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787190665.400081:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f165d86800/lustre-OST0001_UUID 00000020:00000080:2.0:1787190665.400084:0:21374:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d86800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787190665.400091:0:21374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787190665.400203:0:21374:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import aaf1974a-df29-4cc0-91ca-96e33a5a3e1f->MGS 00010000:00010000:2.0:1787190665.400218:0:21374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1700a6400/0xdedcc04674eb41ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb41f1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190665.400231:0:21374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1700a6400/0xdedcc04674eb41ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb41f1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190665.400239:0:21374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787190665.400242:0:21374:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787190665.400246:0:21374:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787190665.400263:0:21374:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:2.0:1787190665.400267:0:21374:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1700a6400/0xdedcc04674eb41ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb41f1 expref: -99 pid: 17930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190665.400282:0:21374:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f158121800/0xdedcc04674eb40d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdedcc04674eb40e0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787190665.400334:0:21374:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f158121800/0xdedcc04674eb40d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdedcc04674eb40e0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190665.400339:0:21374:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787190665.400341:0:21374:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787190665.400343:0:21374:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787190665.400354:0:21374:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99f144dc5000 00010000:00010000:2.0:1787190665.400357:0:21374:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f158121800/0xdedcc04674eb40d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdedcc04674eb40e0 expref: -99 pid: 17177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787190665.400374:0:21374:0:(import.c:65:import_set_state_nolock()) ffff99f144dc5000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787190665.400379:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787190665.400381:0:21374:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787190665.400382:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787190665.400387:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787190665.400399:0:21374:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99f1666cfb80 x1874004695811456/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787190671 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787190665.400420:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787190665.400423:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1787190665.401088:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aaf1974a-df29-4cc0-91ca-96e33a5a3e1f:3650:1874004695811456:0@lo:250:kworker.0 10000000:01000000:2.0:1787190665.401398:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787190665.401408:0:21374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb40c4 00000020:00000080:2.0:1787190665.401415:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f1510b4800/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f 00000020:00000080:3.0:1787190665.403121:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165d81000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1787190665.403983:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.122@tcp (flags='') 00000020:00000080:2.0:1787190665.403998:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787190665.404006:0:21374:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787190665.404011:0:21374:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99f17c37b370) has no exports 00000020:00000080:3.0:1787190665.404090:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1510b4800/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f for MGC192.168.202.122@tcp 10000000:01000000:0.0:1787190665.406710:0:17195:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1787190665.413466:0:21374:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.122@tcp: client import never connected 00000100:00080000:3.0:1787190665.413476:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1787190665.413480:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1787190665.413485:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1787190665.413488:0:21374:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1787190665.413592:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190665.413602:0:21374:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.122@tcp (uuid aaf1974a-df29-4cc0-91ca-96e33a5a3e1f) 00000020:01000000:3.0:1787190665.413612:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787190665.413621:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190665.413627:0:21374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787190665.413636:0:21374:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99f165ed9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787190665.413643:0:21374:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff99f1794b8000) has exports, disconnecting them 00000020:00080000:3.0:1787190665.413647:0:21374:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99f165ed9800), last request at 1787190594 00000020:00000080:3.0:1787190665.413653:0:21374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb4405 00000020:00080000:3.0:1787190665.413669:0:21374:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f165ed9800): rc 0 00000020:00000080:3.0:1787190665.413694:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f165ed9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787190665.413724:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f144dc5000 for MGC192.168.202.122@tcp 00000020:00000080:2.0:1787190665.413734:0:36:0:(genops.c:885:class_export_put()) final put ffff99f144dc6800/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f 00000020:00000080:2.0:1787190665.413737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f144dc6800/aaf1974a-df29-4cc0-91ca-96e33a5a3e1f for MGC192.168.202.122@tcp 00000020:01000000:2.0:1787190665.413746:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.122@tcp (aaf1974a-df29-4cc0-91ca-96e33a5a3e1f) 00010000:01000000:3.0:1787190665.417653:0:21374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787190665.417662:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787190665.417666:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787190665.417673:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787190665.420559:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165ed9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787190665.421641:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190665.421651:0:21374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1787190665.421658:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1787190665.421667:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190665.421671:0:21374:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787190665.421678:0:21374:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff99f17c689000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787190665.421685:0:21374:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff99f165e7cd28) has exports, disconnecting them 00000020:00080000:3.0:1787190665.421690:0:21374:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff99f17c689000), last request at 1787190594 00000020:00000080:3.0:1787190665.421694:0:21374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb441a 00000020:00080000:3.0:1787190665.421710:0:21374:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99f17c689000): rc 0 00000020:00000080:3.0:1787190665.421714:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f17c689000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787190665.425656:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165edf800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787190665.425673:0:36:0:(genops.c:885:class_export_put()) final put ffff99f165edb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787190665.425677:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165edb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787190665.425684:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00010000:01000000:3.0:1787190665.425995:0:21374:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787190665.426000:0:21374:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1787190665.426004:0:21374:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787190665.426008:0:21374:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787190665.426107:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f17c689000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1787190665.426114:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99f165eae800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1787190665.426586:0:17186:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787190665.429110:0:20969:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1787190665.431029:0:17187:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1787190665.437336:0:17181:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99f146b39e00:17181] 0 exiting: rc = 1 00000100:00100000:0.0:1787190665.439057:0:17182:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99f146b39000:17182] 1 exiting: rc = 0 00000100:00100000:3.0:1787190665.439238:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.439619:0:17183:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99f146b38c00:17183] 0 exiting: rc = 1 00000100:00100000:0.0:1787190665.439847:0:17184:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99f146b38800:17184] 1 exiting: rc = 0 00000100:00100000:0.0:1787190665.439908:0:20970:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99f148600c00:20970] 3 exiting: rc = 0 00000100:00100000:0.0:1787190665.441066:0:17185:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99f146b39200:17185] 2 exiting: rc = 0 00000100:00100000:3.0:1787190665.442219:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442228:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442235:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442242:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442249:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442257:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442264:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442269:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442274:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442280:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442463:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442469:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442474:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442480:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442485:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442490:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442495:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442500:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442505:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442511:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442516:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442521:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442526:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442532:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442539:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442545:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442550:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442556:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442561:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442566:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442571:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442576:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442582:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442589:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442594:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442599:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442604:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442609:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442614:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442618:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442623:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442628:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442633:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442638:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442643:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442656:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442661:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442666:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442670:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442675:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442680:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442685:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442691:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442696:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442702:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442708:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442714:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442719:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442724:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442730:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442735:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442740:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442745:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.442749:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787190665.446994:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787190665.447010:0:21374:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1787190665.447018:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f165eaa800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1787190665.447023:0:21374:0:(genops.c:844:class_export_destroy()) destroying export ffff99f165eaa800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1787190665.447033:0:21374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1787190665.447086:0:21374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1776cc800 1 00000020:00000080:3.0:1787190665.447093:0:21374:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdedcc04674eb43bf 00000020:00000080:3.0:1787190665.447099:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f1587c4000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787190665.447184:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787190665.447189:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787190665.447195:0:21374:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787190665.447199:0:21374:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff99f1794b99b8) has no exports 00000020:00000080:0.0:1787190665.455817:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1587c4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1787190665.503747:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190665.503760:0:21374:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1787190665.503766:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f1776c8800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1787190665.503770:0:21374:0:(genops.c:844:class_export_destroy()) destroying export ffff99f1776c8800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1787190665.503782:0:21374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1787190665.506281:0:21374:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99f1776cc000 00000020:01000000:0.0:1787190665.506973:0:21374:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1787190665.506982:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787190665.506987:0:21374:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787190665.506992:0:21374:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff99f1667a8000) has no exports 00000020:00000080:0.0:1787190665.507028:0:21374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787190665.507038:0:21374:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1787190665.507042:0:21374:0:(genops.c:885:class_export_put()) final put ffff99f15ff4d800/OSS_uuid 00000020:00000080:0.0:1787190665.507046:0:21374:0:(genops.c:844:class_export_destroy()) destroying export ffff99f15ff4d800/OSS_uuid for OSS 00000020:01000000:0.0:1787190665.507052:0:21374:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787190665.507603:0:17194:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787190665.511709:0:19231:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99f165ea3c00:19231] 3 exiting: rc = 0 00000100:00100000:0.0:1787190665.511926:0:19595:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff99f165d3dc00:19595] 4 exiting: rc = 0 00000100:00100000:3.0:1787190665.512239:0:18705:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99f17c0b5800:18705] 2 exiting: rc = 0 00000100:00100000:3.0:1787190665.512343:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99f1700d2c00:18702] 0 exiting: rc = 1 00000100:00100000:3.0:1787190665.518626:0:18704:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99f1700bbc00:18704] 1 exiting: rc = 0 00000100:00100000:0.0:1787190665.523522:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523537:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523542:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523549:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523555:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523560:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523565:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523579:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523585:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523590:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523595:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523600:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523605:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523610:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523615:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523620:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523626:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523631:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523636:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523641:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523646:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523651:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523656:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523660:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523665:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523670:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523675:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523679:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523684:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523688:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523693:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523697:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523702:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523707:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523712:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523718:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523723:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523728:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523733:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523737:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523742:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523746:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523756:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523760:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523765:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523770:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523775:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523780:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523785:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523789:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523795:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523800:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523805:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.523810:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524561:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524571:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524576:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524581:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524587:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524592:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524596:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524600:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524605:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.524611:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.527458:0:18706:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99f17c3ec800:18706] 0 exiting: rc = 1 00000100:00100000:0.0:1787190665.527603:0:18707:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99f17c7e0200:18707] 1 exiting: rc = 0 00000100:00100000:2.0:1787190665.528479:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528488:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528493:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528499:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528504:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528510:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528515:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528521:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528527:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528532:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528537:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528543:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528549:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528555:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528560:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528565:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528570:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528575:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528580:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528586:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528591:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528615:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528621:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528625:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528631:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528636:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528640:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528645:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528652:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528657:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528663:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528667:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528672:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528678:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528683:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528688:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528693:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528698:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528703:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528708:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528713:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528718:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528723:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528729:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528734:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528739:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528745:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528751:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528755:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528761:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528766:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528772:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528777:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528783:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528789:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528794:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528807:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528813:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528818:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528823:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528828:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528833:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528839:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.528844:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787190665.531929:0:18710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99f17c7e0000:18710] 2 exiting: rc = 0 00000100:00100000:1.0:1787190665.532225:0:18708:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99f17c7e0c00:18708] 0 exiting: rc = 1 00000100:00100000:0.0:1787190665.532503:0:18709:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99f1700d3e00:18709] 1 exiting: rc = 0 00000100:00100000:2.0:1787190665.532702:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532721:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532743:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532750:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532755:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532760:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532766:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532771:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532776:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532781:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532786:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532791:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532796:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532801:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532805:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532810:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532815:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532820:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532825:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532830:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532836:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532841:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532846:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532851:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532857:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532862:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532891:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532911:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532916:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532922:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532939:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532945:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532950:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532956:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532961:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532966:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532971:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532976:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532982:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532987:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532992:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.532997:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533002:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533007:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533013:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533018:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533024:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533033:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533040:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533046:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533068:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533075:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533091:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533097:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533102:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533108:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533113:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533119:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533125:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533130:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533146:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533152:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533172:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.533179:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787190665.543633:0:18711:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99f17c333400:18711] 0 exiting: rc = 1 00000100:00100000:1.0:1787190665.543740:0:18712:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99f154f36400:18712] 1 exiting: rc = 0 00000100:00100000:2.0:1787190665.544059:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544067:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544073:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544145:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544153:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544158:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544162:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544167:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544173:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544178:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544183:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544188:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544193:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544199:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544204:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544209:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544215:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544220:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544225:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544231:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544236:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544241:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544246:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544251:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544256:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544260:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544266:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544271:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544276:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544281:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544321:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544329:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544336:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544425:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544431:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544437:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544443:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544447:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544452:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544457:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544463:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544468:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544473:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544479:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544485:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544490:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544495:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544501:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544506:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544512:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544517:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544522:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544536:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544543:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544548:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544557:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544566:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544572:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544577:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544582:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544587:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544592:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544597:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.544603:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787190665.548243:0:18714:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99f175dd6a00:18714] 1 exiting: rc = 0 00000100:00100000:1.0:1787190665.549249:0:18713:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99f158803e00:18713] 0 exiting: rc = 1 00000100:00100000:2.0:1787190665.549406:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549415:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549430:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549437:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549456:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549461:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549468:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549476:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549481:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549487:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549494:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549512:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549518:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549524:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549530:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549536:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549543:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549549:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549557:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549563:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549569:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549575:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549581:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549604:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549611:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549617:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549622:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549628:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549634:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549640:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549646:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549653:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549659:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549665:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549672:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549695:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549702:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549708:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549715:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549727:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549732:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549738:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549747:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549752:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549758:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549764:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549770:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549793:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549799:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549805:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549810:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549816:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549821:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549826:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549832:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549838:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549843:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549849:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549855:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549875:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549882:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549888:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549894:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787190665.549900:0:21374:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787190665.563857:0:21374:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787190684.744958:0:22138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787190695.609409:0:22738:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787190695.609416:0:22738:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1787190695.609418:0:22738:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1787190695.609527:0:22738:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99f15e512000 00000020:01000004:2.0:1787190695.609542:0:22738:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787190695.609549:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1787190695.609591:0:22738:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99f1794b8000) 00000020:00000080:2.0:1787190695.609604:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1787190695.657650:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1787190695.658898:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.663152:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.663551:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.663844:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.664607:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.665069:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.665251:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.665536:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.665907:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.666081:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.666356:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.666569:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1787190695.666938:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1787190695.667566:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.667942:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.668121:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.668334:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.668606:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.668881:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.669144:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.669351:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.669567:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.670319:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.670593:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.671041:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.671233:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.671551:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.672170:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.672413:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.672600:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1787190695.672936:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1787190695.673181:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.673557:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.673860:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.674147:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.674371:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1787190695.674553:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1787190695.674938:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1787190695.675129:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1787190695.675365:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.675638:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.676185:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1787190695.676504:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.676755:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.677099:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1787190695.678107:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.679087:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.679492:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.679755:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.680266:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.680574:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1787190695.680921:0:22738:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1787190695.681499:0:22738:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787190695.681716:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787190695.681724:0:22738:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787190695.681735:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb4937 00000020:01000004:2.0:1787190695.681741:0:22738:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1787190695.681746:0:22738:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787190695.681751:0:22738:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99f15e512000 from MGS 00000020:01000004:2.0:1787190695.681755:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787190695.681765:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99f1794bcd28) 00000020:00000080:2.0:1787190695.681774:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787190695.681860:0:22738:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f15e512000 from MGS, refs=2 00080000:01000000:2.0:1787190695.681875:0:22738:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190695.681881:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb4945 00000100:00100000:2.0:1787190695.681971:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787190695.682107:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787190695.682113:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787190695.683078:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787190695.683086:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787190695.684072:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190695.684252:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787190695.684258:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787190695.685010:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787190695.685018:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787190695.685385:0:22738:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787190695.685392:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787190695.686171:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.686177:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.686178:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.686603:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.686607:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.686609:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190695.687778:0:22738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787190695.689473:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787190695.694145:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1787190695.695663:0:22750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787190695.695729:0:22738:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787190695.695779:0:22738:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787190695.696834:0:22738:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787190695.697146:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190695.697349:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787190695.697356:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1787190695.698418:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787190695.698428:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787190695.700048:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787190695.700060:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787190695.701204:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787190695.701230:0:22738:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.122@tcp' 00000020:01000004:2.0:1787190695.701231:0:22738:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787190695.701262:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.122@tcp (typ=mgc) 00000020:00000080:2.0:1787190695.701275:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.122@tcp (ffff99f1794b99b8) 00000020:00000080:2.0:1787190695.701322:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787190695.701405:0:22738:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f17c05c800@MGC192.168.202.122@tcp: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787190695.701566:0:22738:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.122@tcp-0 is initialized 00000040:01000000:2.0:1787190695.701573:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787190695.708175:0:22754:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787190695.710810:0:22756:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787190695.710922:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.122@tcp (uuid edc48c39-e017-41df-adf6-48a4a7c3ab24) 00000020:00000080:1.0:1787190695.710949:0:22738:0:(genops.c:1385:class_connect()) connect: client edc48c39-e017-41df-adf6-48a4a7c3ab24, cookie 0xdedcc04674eb4953 00000100:00080000:1.0:1787190695.710963:0:22738:0:(import.c:510:import_select_connection()) MGC192.168.202.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190695.710969:0:22738:0:(import.c:624:import_select_connection()) MGC192.168.202.122@tcp: import ffff99f17c05c800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190695.711008:0:22738:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffa8a80 x1874004695812096/t0(0) o250->MGC192.168.202.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190695.711036:0:22738:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import edc48c39-e017-41df-adf6-48a4a7c3ab24->MGS 00000020:01000004:1.0:1787190695.711066:0:22738:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787190695.711071:0:22738:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787190695.711085:0:22738:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99f170068000) 00000020:00000080:1.0:1787190695.711096:0:22738:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787190695.712227:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edc48c39-e017-41df-adf6-48a4a7c3ab24:3650:1874004695812096:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787190695.712343:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190695.718857:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812096 00000100:00100000:3.0:1787190695.718884:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812096 00000100:00100000:3.0:1787190695.718937:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190695.718949:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3650:x1874004695812096:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1787190695.718985:0:22751:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from edc48c39-e017-41df-adf6-48a4a7c3ab24@0@lo t0 exp 0000000000000000 cur 672 last 0 00000020:00000080:3.0:1787190695.719022:0:22751:0:(genops.c:1385:class_connect()) connect: client edc48c39-e017-41df-adf6-48a4a7c3ab24, cookie 0xdedcc04674eb4961 00000100:00080000:3.0:1787190695.719199:0:22751:0:(import.c:65:import_set_state_nolock()) ffff99f165d70800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190695.719348:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+5:3650:x1874004695812096:12345-0@lo:250:mount.lustre.0 Request processed in 400us (7004us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190695.719356:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.719567:0:3650:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787190695.719578:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787190695.719586:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787190695.719590:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787190695.719602:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c05c800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787190695.719605:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787190695.719622:0:3650:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787190695.719629:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:edc48c39-e017-41df-adf6-48a4a7c3ab24:3650:1874004695812096:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787190695.725084:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.725322:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787190695.725329:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787190695.727231:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787190695.727243:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787190695.727777:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787190695.727784:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787190695.729046:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.729243:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787190695.729250:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787190695.729927:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787190695.729935:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787190695.760646:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.761004:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787190695.761012:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787190695.762117:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787190695.762127:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787190695.767923:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.768117:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787190695.768122:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787190695.768715:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787190695.768723:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787190695.769607:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.770801:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787190695.770816:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787190695.772488:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787190695.772571:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787190695.773683:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787190695.774074:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787190695.774080:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787190695.774619:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787190695.774626:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787190695.795727:0:22738:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190695.796112:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787190695.796118:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787190695.798710:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787190695.798726:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787190695.799717:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787190695.799728:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787190695.800604:0:22738:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787190695.800637:0:22738:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1787190695.800644:0:22738:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787190695.800754:0:22738:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787190695.800795:0:22738:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787190695.800800:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787190695.800801:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.800802:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.800803:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.800822:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.800824:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.800825:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.800826:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.800828:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.800829:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190695.800832:0:22738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787190695.800834:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190695.800834:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.800835:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.800836:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.800837:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.800838:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.800838:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.800839:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.800840:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.800841:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190695.800887:0:22738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787190695.800909:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812224:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787190695.800986:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.801076:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.801442:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812224 00000100:00100000:2.0:1787190695.801453:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812224 00000100:00100000:2.0:1787190695.801535:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190695.801546:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+5:22738:x1874004695812224:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787190695.801597:0:22753:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787190695.801604:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787190695.801608:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787190695.802017:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787190695.802551:0:22753:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1787190695.804260:0:22775:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787190695.804268:0:22775:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1787190695.804271:0:22775:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787190695.804274:0:22775:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787190695.804544:0:22775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1787190695.804764:0:22753:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787190695.804777:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787190695.806543:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+5:22738:x1874004695812224:12345-0@lo:253:mount.lustre.0 Request processed in 4989us (5547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.806557:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190695.806770:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812224:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787190695.806919:0:22738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787190695.806923:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190695.806925:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.806926:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.806927:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.806928:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.806929:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.806930:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.806932:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.806934:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.806935:0:22738:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787190695.806957:0:22738:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99f15e512000 from lustre-MDT0000 10000000:01000000:1.0:1787190695.806991:0:22738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787190695.806995:0:22738:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787190695.807000:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99f1794b99b8 10000000:01000000:1.0:1787190695.807018:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190695.807027:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99f1794b99b8 from 1 10000000:01000000:1.0:1787190695.807030:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787190695.807075:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.807086:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.807096:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.807119:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190695.807162:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.807248:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.807330:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812352 00000100:00100000:2.0:1787190695.807340:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812352 00000100:00100000:2.0:1787190695.807385:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190695.807395:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+5:22738:x1874004695812352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190695.807412:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190695.807426:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039e200/0xdedcc04674eb496f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4968 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.807452:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039e200/0xdedcc04674eb496f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4968 expref: 6 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.807464:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039e200/0xdedcc04674eb496f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4968 expref: 6 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.807473:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039e200, rc 0) 00000100:00100000:2.0:1787190695.807505:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+6:22738:x1874004695812352:12345-0@lo:101:mount.lustre.0 Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.807511:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190695.808142:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.808165:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.808178:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.808247:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812480:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.808279:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.808330:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823b000 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.808518:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812480 00000100:00100000:2.0:1787190695.808526:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812480 00000100:00100000:2.0:1787190695.808567:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190695.808575:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+6:22738:x1874004695812480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190695.808732:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+6:22738:x1874004695812480:12345-0@lo:501:mount.lustre.0 Request processed in 157us (450us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190695.808739:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190695.809062:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787190695.809102:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787190695.809160:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.809172:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190695.809183:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99f15e512000 10000000:01000000:0.0:1787190695.809189:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787190695.809195:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99f15e512000 10000000:01000000:0.0:1787190695.809198:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787190695.809201:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99f15e512000 from 1 10000000:01000000:0.0:1787190695.809204:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787190695.809234:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.809255:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.809267:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190695.809282:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787190695.809344:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190695.809371:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f145462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.809438:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812608 00000100:00100000:2.0:1787190695.809444:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812608 00000100:00100000:2.0:1787190695.809472:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190695.809480:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+6:22738:x1874004695812608:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190695.809489:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190695.809502:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039f800/0xdedcc04674eb497d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4976 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.809523:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039f800/0xdedcc04674eb497d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4976 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.809532:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039f800/0xdedcc04674eb497d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4976 expref: 7 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.809540:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039f800, rc 0) 00000100:00100000:2.0:1787190695.809577:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+7:22738:x1874004695812608:12345-0@lo:101:mount.lustre.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.809583:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190695.809679:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190695.809691:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb497d expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.809699:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb497d expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190695.809712:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787190695.809939:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb497d expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.809948:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bb800/0xdedcc04674eb4976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb497d expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190695.809955:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787190695.809959:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787190695.809964:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99f15e512000 10000000:01000000:0.0:1787190695.809967:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787190695.809980:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787190695.809982:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787190695.809998:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.810005:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.810012:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190695.810025:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787190695.810051:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190695.810076:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f145462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.810127:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812736 00000100:00100000:2.0:1787190695.810132:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812736 00000100:00100000:2.0:1787190695.810162:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190695.810169:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+7:22738:x1874004695812736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190695.810177:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190695.810185:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039f400/0xdedcc04674eb498b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4984 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.810212:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039f400/0xdedcc04674eb498b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4984 expref: 8 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.810220:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039f400/0xdedcc04674eb498b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4984 expref: 8 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.810227:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039f400, rc 0) 00000100:00100000:2.0:1787190695.810264:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+8:22738:x1874004695812736:12345-0@lo:101:mount.lustre.0 Request processed in 97us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.810269:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190695.810361:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812736:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.810372:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb498b expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.810389:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb498b expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.810436:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.810463:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.810486:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.810547:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812864 00000100:00100000:0.0:1787190695.810552:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812864 00000100:00100000:0.0:1787190695.810571:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190695.810577:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+8:22738:x1874004695812864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190695.810719:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22738:x1874004695812864:12345-0@lo:501:mount.lustre.0 Request processed in 141us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.810725:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190695.810781:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.810827:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190695.810877:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.810902:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.811046:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695812992 00000100:00100000:0.0:1787190695.811051:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695812992 00000100:00100000:0.0:1787190695.811068:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190695.811073:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22738:x1874004695812992:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190695.811817:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22738:x1874004695812992:12345-0@lo:503:mount.lustre.0 Request processed in 733us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.811826:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190695.812020:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695812992:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190695.812566:0:22776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22776:1874004695813120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190695.812611:0:22776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.812646:0:22776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14823b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.812693:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695813120 00000100:00100000:0.0:1787190695.812699:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695813120 00000100:00100000:0.0:1787190695.812768:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190695.812778:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22776:x1874004695813120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190695.813538:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22776:x1874004695813120:12345-0@lo:502:llog_process_th.0 Request processed in 760us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.813547:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787190695.813623:0:22776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22776:1874004695813120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787190695.813648:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.813658:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.813660:0:22776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787190695.813664:0:22776:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787190695.813667:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787190695.813680:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99f1700699b8) 00000020:00000080:1.0:1787190695.813694:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787190695.813698:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787190695.813775:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787190695.813795:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb4999 00000020:00000080:1.0:1787190695.814021:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787190695.814026:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.814029:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.814030:0:22776:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787190695.814033:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.814036:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.814037:0:22776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787190695.814040:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787190695.814046:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99f17006b370) 00000020:00000080:1.0:1787190695.814056:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787190695.814059:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787190695.814061:0:22776:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787190695.814063:0:22776:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787190695.814068:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787190695.814103:0:22776:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f15e512000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787190695.814114:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99f17006cd28) 00000020:00000080:1.0:1787190695.814120:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787190695.814169:0:22776:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787190695.814173:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb49ae 00000020:00000080:1.0:1787190695.814252:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787190695.814258:0:22776:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787190695.814261:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdedcc04674eb49b5 00080000:01000000:1.0:1787190695.814264:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787190695.814267:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb49bc 00010000:00010000:1.0:1787190695.815550:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1787190695.815772:0:22776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1787190695.816134:0:22776:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1787190695.816698:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99f17c37b370) 00000020:00000080:1.0:1787190695.816723:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787190695.816841:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787190695.816848:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb49ca 00000020:00000080:1.0:1787190695.817601:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787190695.827139:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdedcc04674eb49d1 00000020:00000080:1.0:1787190695.830595:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787190695.830610:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.830617:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.830619:0:22776:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787190695.830634:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787190695.830638:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787190695.830639:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787190695.830640:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787190695.830642:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787190695.830645:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.830646:0:22776:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787190695.830649:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.830654:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.830655:0:22776:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787190695.830660:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787190695.830714:0:22776:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787190695.830733:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.830735:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.830737:0:22776:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787190695.830740:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.830743:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.830744:0:22776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1787190695.830747:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787190695.830752:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:1.0:1787190695.830778:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787190695.830965:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff99f17c37cd28) 00000020:00000080:1.0:1787190695.830983:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787190695.830989:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787190695.831043:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1787190695.831049:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787190695.831056:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb49df 00010000:00080000:1.0:1787190695.831089:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f17d08d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787190695.831230:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1787190695.832378:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787190695.832390:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1787190695.832426:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787190695.832446:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb49e6 00000100:00080000:3.0:1787190695.832468:0:22776:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190695.832474:0:22776:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190695.832516:0:22776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf7480 x1874004695813248/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190695.832543:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1787190695.832622:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190695.832626:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.832628:0:22776:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1787190695.832630:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787190695.832633:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1787190695.832634:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190695.832636:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190695.832637:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787190695.832639:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.832641:0:22776:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787190695.832643:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787190695.832647:0:22776:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787190695.832650:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.832651:0:22776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787190695.832654:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787190695.832658:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787190695.832680:0:22776:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787190695.832683:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190695.832701:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99f165e7cd28) 00000020:00000080:3.0:1787190695.832713:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787190695.832718:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787190695.832776:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787190695.832795:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787190695.832802:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb49f4 00000100:00100000:1.0:1787190695.832948:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190695.833024:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787190695.833525:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f15ffbd000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787190695.833671:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1787190695.833967:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695813248 00000100:00100000:2.0:1787190695.833980:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695813248 00000100:00100000:2.0:1787190695.834401:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787190695.834410:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695813248:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1787190695.834428:0:22763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:3.0:1787190695.838926:0:22776:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787190695.839117:0:22776:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787190695.844994:0:22776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190695.845222:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1787190695.852779:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1787190695.853331:0:22782:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1787190695.853336:0:22782:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1787190695.854652:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695813248:12345-0@lo:38:llog_process_th.0 Request processed in 20234us (21620us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787190695.854668:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787190695.854733:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190695.854739:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787190695.854745:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813248:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1787190695.855981:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787190695.855995:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787190695.856034:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787190695.856057:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb49fb 00000100:00080000:3.0:1787190695.856068:0:22776:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190695.856074:0:22776:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99f15ffbd000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190695.856114:0:22776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf5500 x1874004695813376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190695.856140:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787190695.856206:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190695.856211:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.856212:0:22776:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787190695.856215:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787190695.856218:0:22776:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1787190695.856219:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190695.856220:0:22776:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190695.856231:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787190695.856235:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.856236:0:22776:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787190695.856239:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787190695.856243:0:22776:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1787190695.856247:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.856248:0:22776:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787190695.856251:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787190695.856255:0:22776:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787190695.856280:0:22776:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787190695.856283:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190695.856321:0:22776:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99f165e78000) 00000020:00000080:3.0:1787190695.856334:0:22776:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1787190695.856340:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787190695.856397:0:22776:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787190695.856404:0:22776:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1787190695.856410:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdedcc04674eb4a09 00010000:00080000:3.0:1787190695.856442:0:22776:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f17c31d000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787190695.856571:0:22776:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1787190695.856651:0:22776:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787190695.856666:0:22776:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00080000:0.0:1787190695.857054:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787190695.857059:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787190695.857063:0:36:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190695.857068:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 672 00000100:00080000:0.0:1787190695.857072:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787190695.857077:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190695.857093:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fd500 x1874004695813632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190695.857432:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813376:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787190695.857504:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695813376 offset 0 length 520: 4 00000100:00100000:1.0:1787190695.857542:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813632:0@lo:38:kworker.0 00000100:00100000:1.0:1787190695.857575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.857626:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695813632 00000100:00100000:1.0:1787190695.857634:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695813632 00000100:00100000:1.0:1787190695.857672:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190695.857680:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695813632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787190695.857698:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787190695.857740:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695813632:12345-0@lo:38:kworker.0 Request processed in 60us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190695.857747:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787190695.857791:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190695.857796:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787190695.857801:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813632:0@lo:38:kworker.0 00000100:00100000:3.0:1787190695.857917:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695813504:0@lo:400:kworker.0 00000100:00100000:3.0:1787190695.857951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190695.858494:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695813504 00000100:00100000:2.0:1787190695.858503:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695813504 00000100:00100000:2.0:1787190695.858537:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190695.858545:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:3651:x1874004695813504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190695.858608:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:3651:x1874004695813504:12345-0@lo:400:kworker.0 Request processed in 64us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.858614:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190695.858654:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695813504:0@lo:400:kworker.0 00000040:00080000:0.0:1787190695.860617:0:22776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190695.860913:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:0.0:1787190695.861078:0:22776:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1787190695.861636:0:22784:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787190695.861641:0:22784:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787190695.862528:0:22776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787190695.862543:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787190695.862583:0:22776:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787190695.862606:0:22776:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb4a10 00000100:00080000:1.0:1787190695.862616:0:22776:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190695.862624:0:22776:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99f17c31d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190695.862664:0:22776:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffa9880 x1874004695813760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190695.862698:0:22776:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787190695.862890:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.862896:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.862897:0:22776:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787190695.862901:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.862905:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.862907:0:22776:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787190695.862910:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787190695.862912:0:22776:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787190695.862914:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.862917:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.862918:0:22776:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787190695.862921:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.862923:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.862924:0:22776:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787190695.862928:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787190695.862961:0:22776:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22776:1874004695813888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190695.863042:0:22776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.863079:0:22776:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396540 going to sleep for 11 seconds 00000100:00100000:1.0:1787190695.863103:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695813888 00000100:00100000:1.0:1787190695.863110:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695813888 00000100:00100000:1.0:1787190695.863146:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190695.863155:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22776:x1874004695813888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190695.863263:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22776:x1874004695813888:12345-0@lo:502:llog_process_th.0 Request processed in 109us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190695.863269:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190695.863321:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813760:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787190695.863336:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695813760 offset 0 length 520: 4 00000100:00100000:3.0:1787190695.864010:0:22776:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22776:1874004695813888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787190695.864044:0:22776:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190695.864051:0:22776:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190695.864054:0:22776:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787190695.864059:0:22776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1787190695.864237:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1787190695.864258:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787190695.864346:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb498b expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.864359:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bac00/0xdedcc04674eb4984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb498b expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190695.864367:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f15e512000 from 1 10000000:01000000:1.0:1787190695.864369:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787190695.864399:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.864406:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.864415:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.864431:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190695.864469:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.864492:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.864574:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814016 00000100:00100000:2.0:1787190695.864580:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814016 00000100:00100000:2.0:1787190695.864620:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787190695.864629:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+9:22738:x1874004695814016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190695.864639:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190695.864651:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a17 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.864674:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.864684:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.864693:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039ec00, rc 0) 00000100:00100000:2.0:1787190695.864724:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+10:22738:x1874004695814016:12345-0@lo:101:mount.lustre.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.864731:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190695.864946:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.864959:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.864968:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.865556:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814144:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787190695.865604:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.865635:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.865948:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814144 00000100:00100000:2.0:1787190695.865955:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814144 00000100:00100000:2.0:1787190695.865994:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787190695.866004:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+10:22738:x1874004695814144:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787190695.866028:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787190695.866033:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787190695.866104:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+10:22738:x1874004695814144:12345-0@lo:256:mount.lustre.0 Request processed in 102us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.866112:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190695.866190:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814144:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787190695.867139:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190695.867261:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.867274:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190695.867318:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f15e512000 from 1 10000000:01000000:1.0:1787190695.867322:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190695.867358:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.867366:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.867377:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.867396:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190695.867443:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.867473:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.867569:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814272 00000100:00100000:2.0:1787190695.867577:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814272 00000100:00100000:2.0:1787190695.867621:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190695.867630:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+10:22738:x1874004695814272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190695.867641:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190695.867657:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a25 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.867680:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.867690:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 11 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190695.867698:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039e800, rc 0) 00000100:00100000:2.0:1787190695.867733:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814272:12345-0@lo:101:mount.lustre.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.867739:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190695.868004:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.868019:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.868044:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.868110:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.868137:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.868162:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.868215:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814400 00000100:00100000:2.0:1787190695.868220:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814400 00000100:00100000:2.0:1787190695.868242:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190695.868247:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190695.868412:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814400:12345-0@lo:501:mount.lustre.0 Request processed in 163us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.868426:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787190695.868527:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.868556:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190695.868599:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.868616:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.868669:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814528 00000100:00100000:0.0:1787190695.868674:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814528 00000100:00100000:0.0:1787190695.868705:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787190695.868713:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814528:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190695.868931:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814528:12345-0@lo:503:mount.lustre.0 Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.868938:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190695.869020:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190695.869385:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22786:1874004695814656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190695.869434:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190695.869451:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1456ab9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.869541:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814656 00000100:00100000:2.0:1787190695.869546:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814656 00000100:00100000:2.0:1787190695.869577:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787190695.869583:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22786:x1874004695814656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787190695.870066:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22786:x1874004695814656:12345-0@lo:502:llog_process_th.0 Request processed in 482us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.870073:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190695.870162:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22786:1874004695814656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787190695.870191:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.870203:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870206:0:22786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787190695.870213:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f15e512000 00000020:00000080:1.0:1787190695.870216:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190695.870224:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.870227:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870228:0:22786:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787190695.870231:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.870233:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870234:0:22786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787190695.870238:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f15e512000 00000020:00000080:1.0:1787190695.870240:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190695.870331:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.870341:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870342:0:22786:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787190695.870345:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.870347:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870349:0:22786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787190695.870353:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f15e512000 00000020:00000080:1.0:1787190695.870355:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190695.870374:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.870377:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870379:0:22786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787190695.870381:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190695.870384:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870385:0:22786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787190695.870389:0:22786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f15e512000 00000020:00000080:1.0:1787190695.870391:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787190695.870427:0:22786:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22786:1874004695814784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787190695.870464:0:22786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.870483:0:22786:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396900 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.870536:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814784 00000100:00100000:0.0:1787190695.870542:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814784 00000100:00100000:0.0:1787190695.870569:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190695.870575:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22786:x1874004695814784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787190695.870658:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22786:x1874004695814784:12345-0@lo:502:llog_process_th.0 Request processed in 82us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.870665:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190695.870743:0:22786:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22786:1874004695814784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787190695.870762:0:22786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190695.870766:0:22786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190695.870767:0:22786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787190695.870770:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1787190695.870964:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1787190695.870991:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190695.880011:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.880031:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190695.880120:0:22738:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787190695.880123:0:22738:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99f15e512000 10000000:01000000:1.0:1787190695.880126:0:22738:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99f15e512000 10000000:01000000:1.0:1787190695.880131:0:22738:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190695.880137:0:22738:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99f15e512000 from 1 10000000:01000000:1.0:1787190695.880140:0:22738:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787190695.880182:0:22738:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.880191:0:22738:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.880202:0:22738:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.880231:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814912:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190695.880404:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.880447:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396480 going to sleep for 11 seconds 00000100:00100000:1.0:1787190695.880472:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695814912 00000100:00100000:1.0:1787190695.880481:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695814912 00000100:00100000:1.0:1787190695.880931:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190695.880942:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22738:x1874004695814912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.880957:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190695.880971:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b5000/0xdedcc04674eb4a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a33 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.880994:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b5000/0xdedcc04674eb4a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a33 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.881017:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b5000/0xdedcc04674eb4a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a33 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.881027:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b5000, rc 0) 00000100:00100000:1.0:1787190695.881068:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695814912:12345-0@lo:101:mount.lustre.0 Request processed in 128us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190695.881075:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190695.886335:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695814912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190695.886367:0:22738:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a3a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.886381:0:22738:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a3a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190695.886471:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.886536:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.886588:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.886751:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815040 00000100:00100000:2.0:1787190695.886758:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815040 00000100:00100000:2.0:1787190695.886939:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787190695.886952:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190695.887090:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815040:12345-0@lo:501:mount.lustre.0 Request processed in 140us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.887098:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787190695.887197:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190695.887228:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190695.887273:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.887328:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190695.887621:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815168 00000100:00100000:2.0:1787190695.887627:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815168 00000100:00100000:2.0:1787190695.887658:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787190695.887665:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815168:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190695.887744:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815168:12345-0@lo:503:mount.lustre.0 Request processed in 78us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190695.887750:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787190695.889628:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815168:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190695.890359:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.890434:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190695.890479:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190695.893017:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815296 00000100:00100000:3.0:1787190695.893033:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815296 00000100:00100000:3.0:1787190695.893087:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190695.893097:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815296:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.893274:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815296:12345-0@lo:502:llog_process_th.0 Request processed in 178us (2839us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190695.893281:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190695.893967:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815296:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787190695.894041:0:22790:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787190695.894062:0:22790:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99f17c378000) 00000020:00000080:1.0:1787190695.894082:0:22790:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1787190695.894177:0:22790:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f15e512000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787190695.894181:0:22790:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f15e512000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787190695.894183:0:22790:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f15e512000 4 00010000:00080000:1.0:1787190695.894217:0:22790:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f15ffbd800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787190695.894406:0:22790:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1787190695.894576:0:22790:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787190695.894598:0:22790:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787190695.894609:0:22790:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdedcc04674eb4a48 00000100:00080000:1.0:1787190695.894617:0:22790:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190695.894621:0:22790:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99f15ffbd800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190695.894652:0:22790:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffaa300 x1874004695815424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190695.894688:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695815424:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190695.894747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787190695.894800:0:22790:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787190695.895277:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815424 00000100:00100000:0.0:1787190695.895305:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815424 00000100:00100000:0.0:1787190695.895336:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.895343:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874004695815424:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190695.895402:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874004695815424:12345-0@lo:38:llog_process_th.0 Request processed in 59us (655us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787190695.895408:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190695.896199:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787190695.896210:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190695.896216:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787190695.896221:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695815424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787190695.896404:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.896459:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190695.896487:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190695.896503:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815552 00000100:00100000:3.0:1787190695.896509:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815552 00000100:00100000:3.0:1787190695.896544:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190695.896552:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.896663:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815552:12345-0@lo:502:llog_process_th.0 Request processed in 111us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190695.896671:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190695.896711:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.896740:0:22790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.896767:0:22790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190695.896778:0:22790:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190695.897303:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815680 00000100:00100000:3.0:1787190695.897308:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815680 00000100:00100000:3.0:1787190695.897332:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190695.897337:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787190695.897410:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22790:x1874004695815680:12345-0@lo:502:llog_process_th.0 Request processed in 72us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190695.897416:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787190695.897449:0:22790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:edc48c39-e017-41df-adf6-48a4a7c3ab24:22790:1874004695815680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787190695.897467:0:22790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1787190695.897649:0:22738:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787190695.897675:0:22738:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787190695.897695:0:22738:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a3a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.897707:0:22738:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b4800/0xdedcc04674eb4a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a3a expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787190695.897754:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787190695.897756:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.897757:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.897759:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.897760:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.897761:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.897762:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.897764:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.897766:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.897767:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787190695.897771:0:22738:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787190695.897773:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190695.897774:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.897775:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.897776:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.897777:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.897778:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.897788:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.897789:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.897790:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.897791:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787190695.897803:0:22738:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787190695.897956:0:22738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815808:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787190695.897992:0:22738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190695.898012:0:22738:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190695.898709:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815808 00000100:00100000:3.0:1787190695.898718:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815808 00000100:00100000:3.0:1787190695.898747:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787190695.898754:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815808:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787190695.898775:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787190695.899961:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787190695.903165:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787190695.903186:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787190695.903387:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787190695.903394:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787190695.903418:0:22774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.903441:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.903451:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.903497:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.903747:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190695.903765:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695815936:0@lo:104: 00000100:00100000:1.0:1787190695.905123:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22738:x1874004695815808:12345-0@lo:253:mount.lustre.0 Request processed in 6361us (7122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190695.905136:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787190695.905207:0:22738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:22738:1874004695815808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787190695.905220:0:22738:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787190695.905224:0:22738:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190695.905232:0:22738:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787190695.905233:0:22738:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190695.905234:0:22738:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190695.905235:0:22738:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190695.905237:0:22738:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190695.905238:0:22738:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787190695.905240:0:22738:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787190695.905242:0:22738:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190695.905243:0:22738:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787190695.905257:0:22738:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787190695.906436:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190695.906484:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1456abc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190695.908667:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695815936 00000100:00100000:0.0:1787190695.908681:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695815936 00000100:00100000:0.0:1787190695.908737:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.908748:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695815936:12345-0@lo:104: 00010000:00010000:0.0:1787190695.908766:0:22742:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.909010:0:22742:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787190695.909018:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695815936:12345-0@lo:104: Request processed in 272us (2587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.909026:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.909069:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695815936:0@lo:104: 00010000:00010000:0.0:1787190695.909091:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918376:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190695.918393:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918408:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5200 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190695.918413:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918423:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190695.918431:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190695.918437:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190695.918496:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918502:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190695.918532:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918539:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b5200/0xdedcc04674eb4a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a1e expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190695.918579:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.918581:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190695.918583:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190695.918615:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695816064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190695.918692:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190695.919054:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816064 00000100:00100000:0.0:1787190695.919062:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816064 00010000:00010000:0.0:1787190695.919088:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190695.919129:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.919140:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:3652:x1874004695816064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190695.919160:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190695.919167:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919180:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919195:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039ec00/0xdedcc04674eb4a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4a17 expref: 12 pid: 22752 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919209:0:22744:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919216:0:22744:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190695.919232:0:22744:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015837773s 00010000:00010000:0.0:1787190695.919236:0:22744:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919242:0:22744:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919248:0:22744:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919254:0:22744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919259:0:22744:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667baa00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190695.919263:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919277:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919315:0:22744:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919325:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190695.919366:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:3652:x1874004695816064:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190695.919374:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190695.919426:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695816064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190695.919449:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919457:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190695.919462:0:22774:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667baa00/0xdedcc04674eb4a4f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787190695.942675:0:22738:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1787190695.943117:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787190695.946841:0:22799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1787190695.947377:0:22799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190695.949433:0:22799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787190695.949529:0:22799:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1787190695.951642:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1787190695.951938:0:22798:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1787190695.951943:0:22798:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000100:00080000:2.0:1787190695.955220:0:22800:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff99f1666cea00 x1874004695816192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190695.955245:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000040:01000000:1.0:1787190695.955590:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787190695.955615:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787190695.956150:0:22738:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787190695.956198:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787190695.956235:0:22738:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190695.957204:0:22738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787190695.957710:0:22738:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787190695.957742:0:22738:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787190695.960994:0:22738:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1787190695.961444:0:22738:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1787190695.963224:0:22738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1787190695.965932:0:22738:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787190695.965981:0:22738:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb855819eb988 00100000:10000000:0.0:1787190695.965990:0:22738:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787190695.967552:0:22738:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787190695.967572:0:22738:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787190695.967591:0:22738:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787190695.967607:0:22738:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1787190695.968452:0:22738:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787190695.968650:0:22738:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787190696.722583:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190696.979430:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000040:00080000:3.0:1787190696.980334:0:22794:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787190696.980343:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190696.982938:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787190696.982961:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1787190697.491025:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787190697.491035:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f15e512000 from 11 10000000:01000000:1.0:1787190697.491040:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787190697.491089:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190697.491100:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190697.491113:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190697.491139:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695816320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190697.491233:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190697.491283:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190697.491716:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816320 00000100:00100000:3.0:1787190697.491726:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816320 00000100:00100000:3.0:1787190697.491800:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190697.491812:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+11:22756:x1874004695816320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190697.491828:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190697.491863:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a56 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.491888:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.491923:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.491934:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d11400, rc 0) 00000100:00100000:3.0:1787190697.491998:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22756:x1874004695816320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190697.492004:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190697.492054:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695816320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190697.492069:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.492078:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190697.492140:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695816448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787190697.492174:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190697.492397:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190697.492728:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816448 00000100:00100000:1.0:1787190697.492735:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816448 00000100:00100000:1.0:1787190697.492775:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190697.492783:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22756:x1874004695816448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787190697.492800:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787190697.492819:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787190697.492822:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1787190697.492925:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:22756:x1874004695816448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190697.492932:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190697.493138:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695816448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787190697.493254:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787190697.493264:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.493272:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190697.751453:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787190698.004348:0:22794:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000100:00100000:0.0:1787190698.004356:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000040:00080000:2.0:1787190698.004359:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190698.004507:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1787190698.004551:0:22794:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190698.004694:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1787190698.770502:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190699.035070:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:3.0:1787190699.794471:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190700.052354:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000001:02000400:3.0:1787190700.651590:0:23043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787190700.820565:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190701.074370:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000100:00080000:0.0:1787190701.202608:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787190701.202615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787190701.202619:0:36:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190701.202627:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:0.0:1787190701.202633:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787190701.202640:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190701.202666:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fd880 x1874004695816704/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787190701.202680:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190701.202684:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190701.202686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190701.202689:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190701.202692:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787190701.202695:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787190701.202697:0:36:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190701.202710:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99f15ffbd800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190701.202724:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fdc00 x1874004695816832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190701.202845:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190701.202860:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695816576:0@lo:400:kworker.0 00000100:00100000:2.0:1787190701.202945:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190701.203147:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816576 00000100:00100000:0.0:1787190701.203154:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816576 00000100:00100000:0.0:1787190701.203204:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787190701.203214:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:3654:x1874004695816576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190701.203263:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:3654:x1874004695816576:12345-0@lo:400:kworker.0 Request processed in 51us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190701.203270:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190701.203582:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695816704:0@lo:38:kworker.0 00000100:00100000:1.0:1787190701.203615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190701.203644:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695816832:0@lo:38:kworker.0 00000100:00100000:1.0:1787190701.203666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190701.203736:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816704 00000100:00100000:0.0:1787190701.203741:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816704 00000100:00100000:0.0:1787190701.203773:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190701.203779:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695816704:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1787190701.203794:0:22764:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787190701.204706:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816832 00000100:00100000:2.0:1787190701.204716:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816832 00000100:00100000:2.0:1787190701.204759:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190701.204765:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695816832:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787190701.204786:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 678 last 0 00000020:00000080:2.0:1787190701.204836:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdedcc04674eb4a64 00000004:00100000:2.0:1787190701.204852:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787190701.209591:0:22760:0:(import.c:65:import_set_state_nolock()) ffff99f146d13000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190701.209693:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1874004695816832:12345-0@lo:38:kworker.0 Request processed in 4925us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190701.209704:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190701.209768:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695816576:0@lo:400:kworker.0 00010000:00080000:1.0:1787190701.209896:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f1483fdc00 x1874004695816832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190711 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787190701.209912:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1787190701.209929:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787190701.209935:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787190701.209937:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787190701.209944:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3650:1874004695816832:0@lo:38:kworker.0 00000100:00100000:1.0:1787190701.240476:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695816704:12345-0@lo:38:kworker.0 Request processed in 36690us (36854us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190701.240491:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787190701.240649:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190701.240668:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787190701.240673:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695816704:0@lo:38:kworker.0 00000020:00000004:3.0:1787190701.581069:0:23095:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190701.581256:0:23095:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787190701.843725:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190702.098421:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000020:00000004:0.0:1787190702.580690:0:23145:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787190702.584700:0:23145:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787190702.866555:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190703.122493:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:3.0:1787190703.890737:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190704.147357:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:2.0:1787190704.914392:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190705.179877:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000100:00100000:2.0:1787190705.299440:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190695/real 1787190695] req@ffff99f15ffa9880 x1874004695813760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190705.299470:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f15ffa9880 x1874004695813760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190705.299480:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190695/real 1787190695] req@ffff99f17cdf5500 x1874004695813376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190705 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190705.299491:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17cdf5500 x1874004695813376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190705 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787190705.299510:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190705.299529:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787190705.299533:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813760:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787190705.299538:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190705.299542:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787190705.299545:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695813376:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787190705.305763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787190705.305770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787190705.305774:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190705.305801:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 678 00000100:00080000:1.0:1787190705.305807:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787190705.305814:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190705.305839:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffa8e00 x1874004695817088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190705.305858:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190705.305861:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787190705.305863:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190705.305866:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:1.0:1787190705.305869:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787190705.305872:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99f15ffbd000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190705.305897:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffaad80 x1874004695817216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190705.305906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190705.305909:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787190705.305910:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190705.305913:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 673 00000100:00080000:1.0:1787190705.305916:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787190705.305919:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99f17c31d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190705.305930:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffab480 x1874004695817344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190705.306078:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817088:0@lo:38:kworker.0 00000100:00100000:1.0:1787190705.306152:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190705.306205:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817216:0@lo:8:kworker.0 00000400:00000100:1.0:1787190705.306234:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695817216 offset 0 length 520: 4 00000100:00100000:1.0:1787190705.306253:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817344:0@lo:8:kworker.0 00000400:00000100:1.0:1787190705.306269:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695817344 offset 0 length 520: 4 00000100:00100000:1.0:1787190705.306331:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695817472:0@lo:400:kworker.0 00000100:00100000:1.0:1787190705.306359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190705.306395:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817088 00000100:00100000:1.0:1787190705.306402:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817088 00000100:00100000:1.0:1787190705.306433:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190705.306441:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695817088:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1787190705.306460:0:22763:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1787190705.306500:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695817088:12345-0@lo:38:kworker.0 Request processed in 59us (348us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190705.306507:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190705.306541:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817472 00000100:00100000:1.0:1787190705.306544:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817472 00000100:00100000:1.0:1787190705.306573:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190705.306579:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695817472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190705.306621:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695817472:12345-0@lo:400:kworker.0 Request processed in 43us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190705.306628:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787190705.306731:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f15ffaaa00 x1874004695817472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190705.306746:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695817472:0@lo:400:kworker.0 00000100:00080000:1.0:1787190705.306773:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190705.306777:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787190705.306800:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817088:0@lo:38:kworker.0 00000100:00100000:3.0:1787190705.306838:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190705.306852:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695816960:0@lo:400:kworker.0 00000100:00100000:3.0:1787190705.306898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190705.307714:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816960 00000100:00100000:1.0:1787190705.307721:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816960 00000100:00100000:1.0:1787190705.307835:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190705.307844:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:3653:x1874004695816960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190705.307974:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:3653:x1874004695816960:12345-0@lo:400:kworker.0 Request processed in 131us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190705.307981:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190705.308039:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695816960:0@lo:400:kworker.0 00010000:00010000:1.0:1787190705.938612:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190706.195040:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:2.0:1787190706.962411:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190707.218560:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:3.0:1787190707.986986:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190708.243240:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000040:00080000:3.0:1787190708.246272:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787190709.010412:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190709.268024:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000020:01000004:3.0:1787190709.611097:0:23490:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787190709.611101:0:23490:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1787190709.611103:0:23490:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1787190709.611220:0:23490:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99f144dc0000 00000020:01000004:3.0:1787190709.611235:0:23490:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1787190709.611246:0:23490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1787190709.611260:0:23490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff99f165e799b8) 00000020:00000080:3.0:1787190709.611275:0:23490:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787190709.695458:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1787190709.701156:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1787190709.708864:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.709332:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.709594:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.710027:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.710215:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.710843:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.711907:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.712180:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.712603:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.713353:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.713764:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.714062:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.714343:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.714610:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.714844:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.715070:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.715381:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.715844:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.716640:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.717782:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.718200:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.718778:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.719064:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.719380:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.719678:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.720048:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.721366:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.721776:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1787190709.726526:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.727132:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1787190709.727434:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1787190709.727836:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:1.0:1787190709.731022:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.731761:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.732200:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1787190709.732414:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.732622:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1787190709.732785:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.733025:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.733229:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787190709.733428:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787190709.733632:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1787190709.733925:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1787190709.734135:0:23490:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:1.0:1787190709.736162:0:23490:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787190709.736443:0:23490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1787190709.736468:0:23490:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787190709.736480:0:23490:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4a72 00000020:01000004:1.0:1787190709.736487:0:23490:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1787190709.736510:0:23490:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787190709.736526:0:23490:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787190709.736533:0:23490:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1787190709.736575:0:23490:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1787190709.736580:0:23490:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1787190709.747962:0:23490:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787190709.748007:0:23490:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1787190709.748016:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787190709.748017:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787190709.748019:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190709.748020:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190709.748021:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190709.748022:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190709.748023:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190709.748025:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190709.748026:0:23490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787190709.748030:0:23490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1787190709.748032:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787190709.748033:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787190709.748034:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190709.748035:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190709.748036:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190709.748037:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190709.748038:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190709.748038:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190709.748039:0:23490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787190709.748076:0:23490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1787190709.748098:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817600:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787190709.748172:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.748227:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.748371:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817600 00000100:00100000:1.0:1787190709.748379:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817600 00000100:00100000:1.0:1787190709.748473:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787190709.748484:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:23490:x1874004695817600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787190709.748513:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787190709.748516:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1787190709.748524:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1787190709.748834:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:23490:x1874004695817600:12345-0@lo:253:mount.lustre.0 Request processed in 351us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190709.748934:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787190709.748945:0:23490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1787190709.748947:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787190709.748948:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1787190709.748949:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190709.748950:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190709.748950:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190709.748951:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190709.748953:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787190709.748954:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190709.748955:0:23490:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787190709.748972:0:23490:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99f144dc0000 from lustre-MDT0001 10000000:01000000:2.0:1787190709.748996:0:23490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1787190709.748999:0:23490:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787190709.749015:0:23490:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99f1794b99b8 local copy 00010000:00010000:2.0:1787190709.749025:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190709.749104:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817728:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190709.749125:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.749144:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787190709.749207:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957300 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.749338:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817728 00000100:00100000:1.0:1787190709.749341:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817728 00000100:00100000:1.0:1787190709.749353:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787190709.749357:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:23490:x1874004695817728:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190709.749433:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:23490:x1874004695817728:12345-0@lo:501:mount.lustre.0 Request processed in 75us (307us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190709.749438:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190709.749506:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817728:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787190709.749518:0:23490:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787190709.749535:0:23490:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787190709.749540:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.749549:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.749572:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99f144dc0000 10000000:01000000:2.0:1787190709.749577:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787190709.749581:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99f1794b99b8 10000000:01000000:2.0:1787190709.749584:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787190709.749587:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99f1794b99b8 from 1 10000000:01000000:2.0:1787190709.749590:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787190709.749610:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.749616:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.749622:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190709.749635:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817856:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190709.749653:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.749674:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.749713:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817856 00000100:00100000:3.0:1787190709.749717:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817856 00000100:00100000:3.0:1787190709.749733:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787190709.749737:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+12:23490:x1874004695817856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190709.749755:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190709.749772:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d10200/0xdedcc04674eb4a80 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a79 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.749809:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d10200/0xdedcc04674eb4a80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a79 expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.749820:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d10200/0xdedcc04674eb4a80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a79 expref: 13 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.749829:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d10200, rc 0) 00000100:00100000:3.0:1787190709.749874:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+13:23490:x1874004695817856:12345-0@lo:101:mount.lustre.0 Request processed in 135us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.749881:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190709.750053:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190709.750065:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a80 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750074:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a80 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.750088:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787190709.750140:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a80 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750147:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039f200/0xdedcc04674eb4a79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a80 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.750154:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99f144dc0000 10000000:01000000:2.0:1787190709.750158:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787190709.750161:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99f144dc0000 from 1 10000000:01000000:2.0:1787190709.750163:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787190709.750175:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750181:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750188:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190709.750205:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190709.750232:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.750254:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957300 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.750324:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695817984 00000100:00100000:1.0:1787190709.750329:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695817984 00000100:00100000:1.0:1787190709.750354:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787190709.750360:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+13:23490:x1874004695817984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190709.750374:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190709.750382:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b4e00/0xdedcc04674eb4a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a87 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.750396:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b4e00/0xdedcc04674eb4a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a87 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.750404:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b4e00/0xdedcc04674eb4a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a87 expref: 14 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.750410:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b4e00, rc 0) 00000100:00100000:1.0:1787190709.750440:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+14:23490:x1874004695817984:12345-0@lo:101:mount.lustre.0 Request processed in 80us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.750445:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190709.750515:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695817984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190709.750525:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a8e expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750533:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a8e expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.750541:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787190709.750682:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a8e expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750698:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039fe00/0xdedcc04674eb4a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a8e expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.750705:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1787190709.750709:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190709.750713:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99f144dc0000 10000000:01000000:2.0:1787190709.750716:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787190709.750719:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1787190709.750722:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1787190709.750736:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750753:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.750766:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190709.750778:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190709.750803:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.750824:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957300 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.750998:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818112 00000100:00100000:3.0:1787190709.751003:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818112 00000100:00100000:3.0:1787190709.751063:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787190709.751071:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+14:23490:x1874004695818112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190709.751078:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190709.751087:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d10c00/0xdedcc04674eb4a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4a95 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.751103:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d10c00/0xdedcc04674eb4a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4a95 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.751110:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d10c00/0xdedcc04674eb4a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a95 expref: 15 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.751116:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d10c00, rc 0) 00000100:00100000:3.0:1787190709.751154:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818112:12345-0@lo:101:mount.lustre.0 Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.751160:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787190709.751225:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190709.751236:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a9c expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.751244:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4a9c expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190709.753056:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1787190709.753549:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190709.757031:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1787190709.757073:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1787190709.757082:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1787190709.757089:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1787190709.757095:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1787190709.757104:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1787190709.757111:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1787190709.757118:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1787190709.757124:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1787190709.757131:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1787190709.757137:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1787190709.757144:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1787190709.757150:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1787190709.757157:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1787190709.757171:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1787190709.757178:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1787190709.757185:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1787190709.757191:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1787190709.757198:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1787190709.757204:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1787190709.757223:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1787190709.757232:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1787190709.757239:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1787190709.757246:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1787190709.757252:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1787190709.757259:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1787190709.757265:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1787190709.757271:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1787190709.757277:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1787190709.757284:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1787190709.757324:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1787190709.757331:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1787190709.757340:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1787190709.757347:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1787190709.757353:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1787190709.757360:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1787190709.757366:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1787190709.757373:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1787190709.757379:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1787190709.757385:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1787190709.757392:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1787190709.757398:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1787190709.757404:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1787190709.757411:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1787190709.757426:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1787190709.757429:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1787190709.757535:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190709.757610:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.757656:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.758063:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818240 00000100:00100000:1.0:1787190709.758072:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818240 00000100:00100000:1.0:1787190709.758131:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787190709.758141:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190709.758437:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818240:12345-0@lo:501:mount.lustre.0 Request processed in 297us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.758446:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787190709.759278:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818240:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190709.759415:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818368:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190709.759475:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.759676:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957240 going to sleep for 11 seconds 00000100:00100000:0.0:1787190709.759718:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818368 00000100:00100000:0.0:1787190709.759724:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818368 00000100:00100000:0.0:1787190709.759830:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787190709.759847:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190709.761364:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818368:12345-0@lo:503:mount.lustre.0 Request processed in 1512us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.761376:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787190709.761476:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787190709.761972:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190709.762052:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190709.762096:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.764070:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818496 00000100:00100000:0.0:1787190709.764083:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818496 00000100:00100000:2.0:1787190709.764172:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.764224:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190709.764236:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190709.765201:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818496:12345-0@lo:502:mount.lustre.0 Request processed in 964us (3100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.765213:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787190709.765393:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190709.765613:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1787190709.765642:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1787190709.765656:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1787190709.765667:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1787190709.765681:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1787190709.765692:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1787190709.765720:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1787190709.765734:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1787190709.765760:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1787190709.765774:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1787190709.765786:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1787190709.765799:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1787190709.765812:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1787190709.765826:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1787190709.766041:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1787190709.766071:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1787190709.766084:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1787190709.766097:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1787190709.766108:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1787190709.766121:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1787190709.766135:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1787190709.766148:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1787190709.766162:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1787190709.766175:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1787190709.766189:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1787190709.766201:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1787190709.766212:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1787190709.766224:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1787190709.766238:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1787190709.766251:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1787190709.766263:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1787190709.766274:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1787190709.766329:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1787190709.766347:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1787190709.766361:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1787190709.766375:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1787190709.766386:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1787190709.766397:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1787190709.766408:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1787190709.766422:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1787190709.766433:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1787190709.766445:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1787190709.766456:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1787190709.766467:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1787190709.766512:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190709.766574:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.766614:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957240 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.766705:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818624 00000100:00100000:1.0:1787190709.766718:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818624 00000100:00100000:1.0:1787190709.766766:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190709.766774:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190709.767310:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695818624:12345-0@lo:502:mount.lustre.0 Request processed in 512us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.767319:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787190709.767428:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695818624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190709.767483:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1787190709.767491:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1787190709.768374:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190709.768386:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.768388:0:23494:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787190709.768393:0:23494:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1787190709.768396:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190709.768409:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff99f1794bb370) 00000020:00000080:2.0:1787190709.768428:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1787190709.768432:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787190709.768512:0:23494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190709.768519:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4aaa 00000020:00000080:2.0:1787190709.768835:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1787190709.769051:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190709.769056:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.769057:0:23494:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1787190709.769060:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190709.769065:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.769066:0:23494:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1787190709.769069:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190709.769078:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff99f1664099b8) 00000020:00000080:2.0:1787190709.769089:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1787190709.769094:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787190709.769096:0:23494:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1787190709.769098:0:23494:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1787190709.769104:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787190709.769164:0:23494:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f144dc0000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1787190709.769177:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff99f16640b370) 00000020:00000080:2.0:1787190709.769186:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1787190709.769239:0:23494:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787190709.769245:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4abf 00000020:00000080:2.0:1787190709.769413:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1787190709.769420:0:23494:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787190709.769425:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdedcc04674eb4ac6 00080000:01000000:2.0:1787190709.769431:0:23494:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787190709.769435:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4acd 00010000:00010000:2.0:1787190709.770431:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1787190709.770765:0:23494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1787190709.771172:0:23494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787190709.777389:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1787190709.777403:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.777411:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.777413:0:23494:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1787190709.777417:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.777422:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.777424:0:23494:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1787190709.777427:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787190709.777433:0:23494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:00000080:3.0:1787190709.777464:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190709.777479:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff99f165e7b370) 00000020:00000080:3.0:1787190709.777502:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1787190709.777507:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787190709.777582:0:23494:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1787190709.777589:0:23494:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1787190709.777596:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4adb 00010000:00080000:3.0:1787190709.777627:0:23494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f148428000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787190709.777952:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1787190709.779125:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1787190709.779137:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1787190709.779187:0:23494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787190709.779208:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4ae2 00000100:00080000:2.0:1787190709.779217:0:23494:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190709.779222:0:23494:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff99f148428000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190709.779259:0:23494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cf480 x1874004695818752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190709.779323:0:23494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1787190709.779379:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190709.779384:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779385:0:23494:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1787190709.779388:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787190709.779391:0:23494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787190709.779392:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190709.779393:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190709.779394:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787190709.779397:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779399:0:23494:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787190709.779401:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787190709.779405:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779406:0:23494:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1787190709.779409:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787190709.779452:0:23494:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787190709.779466:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787190709.779469:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779470:0:23494:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1787190709.779473:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787190709.779474:0:23494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1787190709.779476:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190709.779477:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787190709.779479:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787190709.779482:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779483:0:23494:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787190709.779485:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190709.779488:0:23494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1787190709.779491:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190709.779493:0:23494:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787190709.779496:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787190709.779499:0:23494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:2.0:1787190709.779568:0:23494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1787190709.779571:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190709.779582:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff99f16640cd28) 00000020:00000080:2.0:1787190709.779594:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787190709.779599:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787190709.779656:0:23494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1787190709.779662:0:23494:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787190709.779667:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4af0 00010000:00080000:2.0:1787190709.779770:0:23494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f158353000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.122@tcp at head 00000100:00080000:0.0:1787190709.779944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787190709.779949:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787190709.779952:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190709.779957:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:0.0:1787190709.779959:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1787190709.779964:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190709.779983:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fd880 x1874004695818880/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787190709.779994:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.779997:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.780000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.780003:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787190709.780050:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695819008:0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.780116:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.780169:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819008 00000100:00100000:0.0:1787190709.780176:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819008 00000100:00100000:0.0:1787190709.780219:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190709.780228:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695819008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.780313:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695819008:12345-0@lo:400:kworker.0 Request processed in 86us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.780321:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787190709.780360:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f1483fdc00 x1874004695819008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190709.780374:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695819008:0@lo:400:kworker.0 00010000:00010000:2.0:1787190709.781994:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1787190709.782704:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695818752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787190709.782800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.782851:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695818880:0@lo:38:kworker.0 00000100:00100000:3.0:1787190709.782878:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.783221:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818752 00000100:00100000:0.0:1787190709.783230:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818752 00000100:00100000:0.0:1787190709.783252:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695818880 00000100:00100000:0.0:1787190709.783255:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695818880 00000100:00100000:0.0:1787190709.783266:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190709.783273:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695818752:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787190709.783321:0:22763:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 686 last 0 00000020:00000080:0.0:1787190709.783355:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4af7 00000004:00100000:0.0:1787190709.783370:0:22763:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1787190709.783375:0:22763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:2.0:1787190709.783775:0:23494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1787190709.784206:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1787190709.788482:0:23494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190709.789523:0:23494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1787190709.789676:0:23494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:0.0:1787190709.789958:0:22763:0:(import.c:65:import_set_state_nolock()) ffff99f17c2fc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190709.790121:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1874004695818752:12345-0@lo:38:llog_process_th.0 Request processed in 6844us (7319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.790128:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1787190709.790133:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787190709.790139:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000040:00080000:2.0:1787190709.790182:0:23499:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787190709.790192:0:23499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00080000:1.0:1787190709.790219:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1787190709.790226:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787190709.790229:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f148428000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787190709.790344:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695818752:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190709.790414:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190709.790420:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695818880:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1787190709.790473:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3650:x1874004695818880:12345-0@lo:38:kworker.0 Request processed in 51us (7593us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787190709.790480:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190709.790485:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787190709.790490:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190709.790494:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787190709.790498:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695818880:0@lo:38:kworker.0 00000100:00100000:1.0:1787190709.790623:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695819136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190709.790655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.790689:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819136 00000100:00100000:0.0:1787190709.790695:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819136 00000100:00100000:0.0:1787190709.790727:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190709.790733:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874004695819136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787190709.790769:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787190709.791404:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1874004695819136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 668us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.791412:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695819136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190709.791412:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:00000080:3.0:1787190709.792055:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190709.792070:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787190709.792113:0:23494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787190709.792133:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4afe 00000100:00080000:3.0:1787190709.792141:0:23494:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190709.792148:0:23494:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99f158353000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190709.792174:0:23494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf5500 x1874004695819264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190709.792209:0:23494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1787190709.792248:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695819264:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787190709.792282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000400:00000100:1.0:1787190709.792307:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695819264 offset 0 length 520: 4 00000100:00080000:0.0:1787190709.792307:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.792311:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.792324:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:3.0:1787190709.792325:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.792331:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.792333:0:23494:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787190709.792337:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787190709.792341:0:23494:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1787190709.792343:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190709.792345:0:23494:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787190709.792347:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787190709.792349:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.792351:0:23494:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787190709.792354:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787190709.792358:0:23494:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1787190709.792361:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.792362:0:23494:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787190709.792366:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787190709.792370:0:23494:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.122@tcp to nid 0x20000c0a8ca7a (192.168.202.122@tcp) 00000020:01000000:3.0:1787190709.792392:0:23494:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1787190709.792394:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190709.792407:0:23494:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff99f14866cd28) 00000020:00000080:3.0:1787190709.792419:0:23494:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1787190709.792425:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787190709.792483:0:23494:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1787190709.792489:0:23494:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787190709.792495:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdedcc04674eb4b0c 00010000:00080000:3.0:1787190709.792522:0:23494:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f143e76000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787190709.792644:0:23494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1787190709.792704:0:23494:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787190709.792718:0:23494:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1787190709.795772:0:23494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190709.796181:0:23494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1787190709.796572:0:23494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1787190709.796883:0:23501:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1787190709.796888:0:23501:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787190709.797582:0:23494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1787190709.797595:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787190709.797630:0:23494:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787190709.797647:0:23494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4b13 00000100:00080000:3.0:1787190709.797655:0:23494:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190709.797660:0:23494:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99f143e76000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190709.797686:0:23494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf5f80 x1874004695819392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190709.797707:0:23494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1787190709.797737:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695819392:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1787190709.797810:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695819392 offset 0 length 520: 4 00000020:01000000:3.0:1787190709.797811:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.797815:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.797817:0:23494:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787190709.797819:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.797823:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.797824:0:23494:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787190709.797827:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190709.797828:0:23494:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787190709.797830:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.797832:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.797833:0:23494:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787190709.797835:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.797837:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.797838:0:23494:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787190709.797842:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787190709.797864:0:23494:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.797867:0:23494:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.797869:0:23494:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787190709.797872:0:23494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1787190709.797934:0:23490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1787190709.797973:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1787190709.797988:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a9c expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.797999:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039e600/0xdedcc04674eb4a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4a9c expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190709.798007:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f144dc0000 from 1 10000000:01000000:1.0:1787190709.798010:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00080000:0.0:1787190709.798025:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.798029:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.798031:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00010000:00010000:1.0:1787190709.798034:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787190709.798034:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787190709.798041:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.798052:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190709.798066:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190709.798094:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.798111:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e46240 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.798129:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819520 00000100:00100000:3.0:1787190709.798136:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819520 00000100:00100000:3.0:1787190709.798179:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787190709.798188:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+15:23490:x1874004695819520:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190709.798217:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190709.798229:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b1a expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.798253:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 16 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.798264:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 16 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.798274:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d11000, rc 0) 00000100:00100000:3.0:1787190709.798353:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:23490:x1874004695819520:12345-0@lo:101:mount.lustre.0 Request processed in 166us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.798360:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787190709.798581:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190709.798592:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.798597:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190709.799136:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819648:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1787190709.800024:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.800127:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e46240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190709.800395:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819648 00000100:00100000:2.0:1787190709.800403:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819648 00000100:00100000:2.0:1787190709.800444:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787190709.800455:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:23490:x1874004695819648:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787190709.800475:0:22751:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787190709.800492:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787190709.800496:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1787190709.800798:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:23490:x1874004695819648:12345-0@lo:256:mount.lustre.0 Request processed in 345us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190709.800806:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787190709.800876:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819648:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1787190709.801705:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190709.802313:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.802326:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190709.802334:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f144dc0000 from 1 10000000:01000000:1.0:1787190709.802337:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190709.802368:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.802375:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.802385:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190709.802406:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190709.802449:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.802482:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e46240 going to sleep for 11 seconds 00000100:00100000:0.0:1787190709.802501:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819776 00000100:00100000:0.0:1787190709.802508:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819776 00000100:00100000:0.0:1787190709.802598:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787190709.802608:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:23490:x1874004695819776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190709.802620:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190709.802630:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b28 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.802664:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.802674:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.802682:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667ba000, rc 0) 00000100:00100000:0.0:1787190709.802720:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695819776:12345-0@lo:101:mount.lustre.0 Request processed in 114us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.802725:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787190709.802841:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190709.802854:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.802862:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190709.804592:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1787190709.804883:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190709.805046:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1787190709.805073:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1787190709.805087:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1787190709.805101:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1787190709.805113:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1787190709.805127:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1787190709.805141:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1787190709.806807:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1787190709.806819:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1787190709.806834:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1787190709.806841:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1787190709.806855:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1787190709.806858:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1787190709.806933:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190709.806984:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.807025:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15161b780 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.807038:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695819904 00000100:00100000:1.0:1787190709.807045:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695819904 00000100:00100000:1.0:1787190709.807092:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190709.807102:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695819904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190709.807536:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695819904:12345-0@lo:501:mount.lustre.0 Request processed in 434us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.807543:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787190709.807593:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695819904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190709.807622:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190709.807656:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.807703:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820032 00000100:00100000:0.0:1787190709.807708:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820032 00000100:00100000:2.0:1787190709.807748:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15161b780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190709.807812:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787190709.807819:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190709.807901:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820032:12345-0@lo:503:mount.lustre.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.807908:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190709.807925:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787190709.809487:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190709.809550:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190709.809614:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.809653:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14630b180 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.809690:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820160 00000100:00100000:1.0:1787190709.809696:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820160 00000100:00100000:1.0:1787190709.809757:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787190709.809766:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190709.809874:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820160:12345-0@lo:502:mount.lustre.0 Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.809882:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787190709.810494:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190709.810793:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1787190709.810821:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1787190709.810833:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1787190709.810844:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1787190709.810854:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1787190709.810864:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1787190709.810875:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1787190709.810885:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1787190709.810896:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1787190709.810905:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1787190709.810915:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1787190709.810941:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820288:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190709.810984:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.811012:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1446b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787190709.811120:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820288 00000100:00100000:2.0:1787190709.811126:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820288 00000100:00100000:2.0:1787190709.811386:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190709.811396:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190709.811499:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820288:12345-0@lo:502:mount.lustre.0 Request processed in 104us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190709.811505:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787190709.812446:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820288:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190709.812526:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:3.0:1787190709.812539:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787190709.816467:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.816479:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.816481:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787190709.816489:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f144dc0000 00000020:00000080:3.0:1787190709.816491:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190709.816500:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.816503:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.816505:0:23503:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787190709.816507:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.816510:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.816511:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787190709.816515:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f144dc0000 00000020:00000080:3.0:1787190709.816517:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190709.816622:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.816627:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.816628:0:23503:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787190709.816631:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.816633:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.816635:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190709.816638:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f144dc0000 00000020:00000080:3.0:1787190709.816640:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190709.827251:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.827281:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.827283:0:23503:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190709.827304:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190709.827309:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.827311:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787190709.827316:0:23503:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f144dc0000 00000020:00000080:3.0:1787190709.827318:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190709.827392:0:23503:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190709.827395:0:23503:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190709.827397:0:23503:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787190709.827400:0:23503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1787190709.831933:0:23490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1787190709.831984:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190709.832006:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.832027:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190709.832078:0:23490:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787190709.832081:0:23490:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99f144dc0000 10000000:01000000:2.0:1787190709.832084:0:23490:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99f144dc0000 10000000:01000000:2.0:1787190709.832088:0:23490:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787190709.832093:0:23490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99f144dc0000 from 1 10000000:01000000:2.0:1787190709.832096:0:23490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787190709.832129:0:23490:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.832138:0:23490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.832151:0:23490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190709.832175:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820416:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190709.832242:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190709.832312:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1702579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.833816:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820416 00000100:00100000:1.0:1787190709.833829:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820416 00000100:00100000:1.0:1787190709.833886:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787190709.833897:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:23490:x1874004695820416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190709.833913:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190709.833928:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b4400/0xdedcc04674eb4b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b36 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.833956:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b4400/0xdedcc04674eb4b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b36 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.833968:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b4400/0xdedcc04674eb4b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b36 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.833977:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b4400, rc 0) 00000100:00100000:1.0:1787190709.834034:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820416:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.834051:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787190709.834449:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820416:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190709.834468:0:23490:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b3d expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190709.834479:0:23490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b3d expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190709.841849:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1787190709.842162:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190709.842420:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1787190709.842444:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1787190709.842456:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1787190709.842468:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1787190709.842480:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1787190709.842492:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1787190709.842504:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1787190709.842516:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1787190709.842528:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1787190709.842556:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1787190709.842570:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1787190709.842581:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1787190709.842593:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1787190709.842605:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1787190709.842618:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1787190709.842630:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1787190709.842642:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1787190709.842655:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1787190709.842668:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1787190709.842681:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1787190709.842978:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1787190709.842991:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1787190709.843003:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1787190709.843016:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1787190709.843028:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1787190709.843053:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1787190709.843066:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1787190709.843078:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1787190709.843090:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1787190709.843102:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1787190709.843114:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1787190709.843126:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1787190709.843138:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1787190709.843150:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1787190709.843164:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1787190709.843175:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1787190709.843188:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1787190709.843201:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1787190709.843214:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1787190709.843227:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1787190709.843239:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1787190709.843263:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1787190709.843328:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1787190709.843347:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1787190709.843361:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1787190709.843374:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1787190709.843387:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1787190709.843399:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1787190709.843519:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1787190709.843539:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1787190709.843556:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1787190709.843568:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1787190709.843654:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190709.845590:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.845851:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820544 00000100:00100000:1.0:1787190709.845860:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820544 00000100:00100000:1.0:1787190709.845919:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787190709.845928:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190709.846052:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820544:12345-0@lo:501:mount.lustre.0 Request processed in 125us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.846060:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787190709.846217:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190709.846236:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190709.846271:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190709.846552:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.846583:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.846716:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820672 00000100:00100000:3.0:1787190709.846722:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820672 00000100:00100000:3.0:1787190709.846762:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787190709.846770:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1453c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820672:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190709.846852:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1453c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820672:12345-0@lo:503:mount.lustre.0 Request processed in 82us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.846859:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787190709.847269:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787190709.847785:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787190709.847841:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190709.847874:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.847901:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190709.847914:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820800 00000100:00100000:2.0:1787190709.847920:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820800 00000100:00100000:2.0:1787190709.847957:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787190709.847965:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1453c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190709.848047:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1453c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820800:12345-0@lo:502:mount.lustre.0 Request processed in 82us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190709.848054:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787190709.848405:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787190709.848545:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1787190709.848561:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1787190709.848580:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1787190709.848588:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1787190709.849375:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1787190709.849401:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1787190709.849415:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1787190709.849426:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1787190709.849433:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1787190709.849440:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1787190709.849446:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1787190709.849453:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1787190709.849460:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1787190709.849466:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1787190709.849473:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1787190709.849479:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1787190709.849486:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1787190709.849492:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1787190709.849510:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1787190709.849518:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1787190709.849525:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1787190709.849532:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1787190709.849538:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1787190709.849547:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1787190709.849554:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1787190709.849561:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1787190709.849567:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1787190709.849574:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1787190709.849580:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1787190709.849587:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1787190709.849640:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1787190709.849653:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1787190709.849660:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1787190709.849673:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1787190709.850223:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1787190709.850249:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1787190709.850263:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1787190709.850285:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1787190709.850388:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1787190709.850402:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1787190709.850414:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1787190709.850426:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1787190709.850438:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1787190709.850452:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1787190709.850466:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1787190709.850479:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1787190709.850491:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1787190709.850503:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1787190709.850548:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190709.850678:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.850976:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.851043:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695820928 00000100:00100000:3.0:1787190709.851050:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695820928 00000100:00100000:3.0:1787190709.851097:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787190709.851105:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190709.851674:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695820928:12345-0@lo:502:mount.lustre.0 Request processed in 568us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.851683:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787190709.851872:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695820928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787190709.852058:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1787190709.852094:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1787190709.852123:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695821056:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190709.852451:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.852517:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190709.852541:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821056 00000100:00100000:0.0:1787190709.852547:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821056 00000100:00100000:3.0:1787190709.852683:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787190709.852693:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695821056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190709.852806:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695821056:12345-0@lo:502:mount.lustre.0 Request processed in 115us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.852813:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787190709.852890:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695821056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190709.852941:0:23490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1787190709.852950:0:23490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1787190709.854415:0:23509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1787190709.854431:0:23509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff99f17c3799b8) 00000020:00000080:1.0:1787190709.854454:0:23509:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1787190709.854531:0:23509:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f144dc0000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787190709.854535:0:23509:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f144dc0000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1787190709.854537:0:23509:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f144dc0000 3 00010000:00080000:1.0:1787190709.854565:0:23509:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f17c59d000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.122@tcp at head 00010000:00010000:1.0:1787190709.854780:0:23509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1787190709.854953:0:23509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1787190709.854975:0:23509:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787190709.854983:0:23509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdedcc04674eb4b4b 00000100:00080000:1.0:1787190709.854991:0:23509:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787190709.854995:0:23509:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff99f17c59d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190709.855026:0:23509:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffaaa00 x1874004695821184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190709.855061:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874004695821184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787190709.855120:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.855695:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821184 00000100:00100000:1.0:1787190709.855703:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821184 00000100:00100000:1.0:1787190709.855734:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190709.855750:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695821184:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787190709.855774:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 687 last 0 00000020:00000080:1.0:1787190709.855811:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdedcc04674eb4b52 00000004:00100000:1.0:1787190709.855826:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787190709.855850:0:22760:0:(import.c:65:import_set_state_nolock()) ffff99f17c724800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190709.855942:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1874004695821184:12345-0@lo:38:llog_process_th.0 Request processed in 199us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.855949:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1787190709.855966:0:23509:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00080000:3.0:1787190709.856242:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f15ffaaa00 x1874004695821184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190709.856253:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190709.856261:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787190709.856273:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787190709.856277:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787190709.856280:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c59d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000040:00080000:1.0:1787190709.856951:0:23509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000100:00100000:3.0:1787190709.858236:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3650:1874004695821184:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1787190709.858277:0:23490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1787190709.858333:0:23490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787190709.858349:0:23490:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b3d expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.858361:0:23490:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039ee00/0xdedcc04674eb4b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b3d expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787190709.858409:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787190709.858411:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787190709.858412:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190709.858413:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190709.858415:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190709.858416:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190709.858417:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190709.858419:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190709.858420:0:23490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787190709.858424:0:23490:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1787190709.858426:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787190709.858428:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787190709.858429:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190709.858430:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190709.858431:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190709.858432:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190709.858433:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190709.858434:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190709.858435:0:23490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787190709.858458:0:23490:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1787190709.858475:0:23490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695821312:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787190709.858544:0:23490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.858578:0:23490:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15e957c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.858611:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821312 00000100:00100000:3.0:1787190709.858618:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821312 00000100:00100000:3.0:1787190709.858662:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787190709.858671:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695821312:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787190709.858696:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787190709.858708:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1787190709.860147:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787190709.860153:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1787190709.860157:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787190709.860166:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190709.860194:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1483fdf80 x1874004695821440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787190709.860240:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.860243:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.860246:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.860248:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.864060:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.864068:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190709.864071:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190709.864074:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787190709.864239:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695821568:0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.864512:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.864571:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695821696:0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.864604:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.864647:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821568 00000100:00100000:0.0:1787190709.864655:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821568 00000100:00100000:0.0:1787190709.864713:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190709.864717:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821696 00000100:00100000:3.0:1787190709.864721:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821696 00000100:00100000:0.0:1787190709.864723:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695821568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190709.864758:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190709.864764:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695821696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.864785:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695821568:12345-0@lo:400:kworker.0 Request processed in 64us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.864792:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787190709.864798:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695821696:12345-0@lo:400:kworker.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.864803:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787190709.864835:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f1483fce00 x1874004695821568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190709.864860:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695821568:0@lo:400:kworker.0 00000100:00100000:0.0:1787190709.864898:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695821696:0@lo:400:kworker.0 00000100:00100000:1.0:1787190709.865620:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695821440:0@lo:38:kworker.0 00000100:00100000:1.0:1787190709.865659:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.865696:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821440 00000100:00100000:3.0:1787190709.865701:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821440 00000100:00100000:3.0:1787190709.865729:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190709.865734:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695821440:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1787190709.865802:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695821440:12345-0@lo:38:kworker.0 Request processed in 66us (141us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787190709.865809:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787190709.865828:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787190709.865833:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787190709.865836:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695821440:0@lo:38:kworker.0 00000001:00100000:0.0:1787190709.866708:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1787190709.867241:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787190709.867259:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1787190709.867951:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:23490:x1874004695821312:12345-0@lo:253:mount.lustre.0 Request processed in 9277us (9402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.867962:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 20000000:01000000:1.0:1787190709.868001:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787190709.868007:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787190709.868034:0:22774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190709.868035:0:23490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:23490:1874004695821312:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1787190709.868048:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190709.868056:0:23490:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1787190709.868059:0:23490:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787190709.868060:0:23490:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1787190709.868062:0:23490:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190709.868063:0:23490:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190709.868064:0:23490:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:1.0:1787190709.868065:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787190709.868066:0:23490:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190709.868067:0:23490:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787190709.868069:0:23490:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190709.868071:0:23490:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:1.0:1787190709.868073:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1787190709.868083:0:23490:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787190709.868107:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869390:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 17 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190709.869409:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695821824:0@lo:104: 00000100:00100000:1.0:1787190709.869460:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190709.869513:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869523:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190709.869531:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695821952:0@lo:104: 00000100:00100000:1.0:1787190709.869551:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190709.869568:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16081dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787190709.869603:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821824 00000100:00100000:1.0:1787190709.869610:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821824 00000100:00100000:1.0:1787190709.869641:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695821952 00000100:00100000:1.0:1787190709.869643:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695821952 00000100:00100000:1.0:1787190709.869657:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190709.869665:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695821824:12345-0@lo:104: 00010000:00010000:1.0:1787190709.869697:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869756:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190709.869762:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695821824:12345-0@lo:104: Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.869768:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787190709.869784:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190709.869790:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695821952:12345-0@lo:104: 00010000:00010000:1.0:1787190709.869797:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869826:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787190709.869830:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695821952:12345-0@lo:104: Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190709.869836:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787190709.869927:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190709.869934:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869940:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5800 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190709.869944:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.869952:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190709.869959:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190709.869973:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190709.870010:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870017:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787190709.870435:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695821824:0@lo:104: 00000100:00100000:3.0:1787190709.870447:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695821952:0@lo:104: 00010000:00010000:1.0:1787190709.870448:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870455:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b21 expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.870466:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870467:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190709.870470:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870476:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4600 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190709.870478:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870485:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190709.870492:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190709.870497:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190709.870521:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870528:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190709.870547:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870554:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a5d expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190709.870566:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190709.870568:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190709.870570:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190709.870576:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190709.870783:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695822080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190709.870820:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.871261:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695822208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190709.871796:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190709.872181:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822080 00000100:00100000:0.0:1787190709.872189:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822080 00010000:00010000:0.0:1787190709.872220:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 18 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190709.872247:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822208 00000100:00100000:0.0:1787190709.872250:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822208 00010000:00010000:0.0:1787190709.872262:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 19 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190709.872276:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190709.872283:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:3652:x1874004695822080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190709.872389:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190709.872395:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 19 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872408:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 19 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872423:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d11000/0xdedcc04674eb4b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b1a expref: 19 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872456:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190709.872496:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3652:x1874004695822080:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.872503:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190709.872518:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190709.872524:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:3653:x1874004695822208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190709.872532:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190709.872536:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872544:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872554:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4a56 expref: 17 pid: 22752 timeout: 787 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872565:0:22744:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872574:0:22744:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190709.872588:0:22744:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015837773s 00010000:00010000:0.0:1787190709.872592:0:22744:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872600:0:22744:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872616:0:22744:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872623:0:22744:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872628:0:22744:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4a00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190709.872632:0:22744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872641:0:22744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872663:0:22744:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190709.872676:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190709.872682:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.872690:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190709.872696:0:22774:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1703b4a00/0xdedcc04674eb4b59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190709.872874:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:3653:x1874004695822208:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190709.872881:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190709.872917:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695822080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190709.872992:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695822208:0@lo:103:ldlm_bl.0 00000040:01000000:1.0:1787190709.875966:0:23490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1787190709.876179:0:23514:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1787190709.876184:0:23514:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1787190709.876321:0:23515:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787190709.876781:0:23490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:1.0:1787190709.876941:0:23515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787190709.878180:0:23516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822336:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.878267:0:23516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.878347:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822336 00000100:00100000:3.0:1787190709.878362:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822336 00000100:00100000:3.0:1787190709.878407:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190709.878416:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822336:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.878488:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822336:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.878494:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190709.878515:0:23516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158dc8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.878538:0:23516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822336:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1787190709.878564:0:23516:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787190709.878588:0:23516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.878612:0:23516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.878630:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822464 00000100:00100000:3.0:1787190709.878633:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822464 00000100:00100000:3.0:1787190709.878655:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190709.878661:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822464:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.879905:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822464:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 1238us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.879916:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190709.879948:0:23516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.879970:0:23516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822464:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880045:0:23516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23516:1874004695822592:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880075:0:23516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.880120:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822592 00000100:00100000:3.0:1787190709.880125:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822592 00000100:00100000:3.0:1787190709.880152:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190709.880160:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1874004695822592:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880209:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23516:x1874004695822592:12345-0@lo:900:lod0001_rec0000.0 Request processed in 49us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.880215:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787190709.880233:0:23516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bc180 going to sleep for 11 seconds 00010000:00080000:3.0:1787190709.880249:0:23516:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99f17cdf7480 x1874004695822592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787190725 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190709.880260:0:23516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23516:1874004695822592:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880341:0:23516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822720:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880367:0:23516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190709.880384:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822720 00000100:00100000:3.0:1787190709.880387:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822720 00000100:00100000:3.0:1787190709.880405:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190709.880411:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822720:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1787190709.880470:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23516:x1874004695822720:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 59us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190709.880477:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190709.880491:0:23516:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bcc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190709.880502:0:23516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23516:1874004695822720:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1787190709.880539:0:23516:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1787190709.880935:0:23490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1787190709.880972:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787190709.881405:0:23490:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787190709.881412:0:23490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1787190709.881448:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190709.882454:0:23490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787190709.882991:0:23490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1787190709.883022:0:23490:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1787190709.883143:0:23490:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1787190709.883660:0:23490:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:1.0:1787190709.884807:0:23515:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787190709.884879:0:23515:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1787190709.892703:0:23516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787190709.892805:0:23516:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787190709.892811:0:23516:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1787190709.895118:0:23490:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1787190709.896947:0:23490:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787190709.896980:0:23490:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb855819fb988 00100000:10000000:2.0:1787190709.896987:0:23490:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1787190709.897608:0:23490:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787190709.897637:0:23490:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787190709.897668:0:23490:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787190709.897698:0:23490:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1787190709.898523:0:23490:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190709.898730:0:23490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1787190710.034516:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190710.297399:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000040:00080000:1.0:1787190710.869348:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787190711.058452:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190711.316449:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 10000000:01000000:3.0:1787190711.634981:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787190711.634988:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f144dc0000 from 12 10000000:01000000:3.0:1787190711.634994:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787190711.635048:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190711.635060:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190711.635072:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190711.635098:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695822848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190711.635166:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190711.635212:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190711.635440:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822848 00000100:00100000:1.0:1787190711.635448:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822848 00000100:00100000:1.0:1787190711.635587:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190711.635597:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:22756:x1874004695822848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190711.635610:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190711.635624:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b60 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190711.635661:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190711.635693:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190711.635701:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b5600, rc 0) 00000100:00100000:1.0:1787190711.635764:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695822848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190711.635771:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787190711.635805:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695822848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190711.635820:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190711.636143:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190711.636217:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695822976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787190711.636251:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190711.636273:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652840 going to sleep for 11 seconds 00000100:00100000:3.0:1787190711.636403:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695822976 00000100:00100000:3.0:1787190711.636409:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695822976 00000100:00100000:3.0:1787190711.636447:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190711.636455:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695822976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787190711.636471:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787190711.636487:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787190711.636490:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1787190711.636559:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695822976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190711.636566:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787190711.636766:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695822976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787190711.636810:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787190711.636817:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190711.637100:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190711.637112:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787190711.637114:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f15e512000 from 12 10000000:01000000:0.0:1787190711.637117:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787190711.637138:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190711.637146:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190711.637156:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190711.637168:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695823104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190711.637434:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190711.637456:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823104 00000100:00100000:0.0:1787190711.637456:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166652840 going to sleep for 11 seconds 00000100:00100000:3.0:1787190711.637461:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823104 00000100:00100000:3.0:1787190711.637496:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787190711.637503:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695823104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190711.637512:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190711.637522:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b6e expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190711.637543:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190711.637553:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 18 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190711.637561:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d11400, rc 0) 00000100:00100000:3.0:1787190711.637595:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695823104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190711.637601:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787190711.637809:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695823104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190711.637823:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190711.637832:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190711.637890:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695823232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787190711.637920:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190711.637941:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190711.637975:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823232 00000100:00100000:0.0:1787190711.637986:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823232 00000100:00100000:0.0:1787190711.638009:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787190711.638014:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695823232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787190711.638027:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787190711.638041:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787190711.638044:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1787190711.638123:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695823232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190711.638129:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787190711.638846:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695823232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787190711.638893:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787190711.638900:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190711.638909:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190711.894232:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787190712.089882:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190712.346201:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:3.0:1787190713.112763:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190713.362601:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00010000:00010000:0.0:1787190714.130976:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190714.386869:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 0 seconds 00000001:02000400:3.0:1787190714.948685:0:23759:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787190715.032492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787190715.032498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1787190715.032502:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190715.032515:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff99f17d08d800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190715.032538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffab100 x1874004695823488/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190715.032555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190715.032558:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190715.032560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190715.032576:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190715.032607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190715.032611:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190715.032614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190715.032617:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787190715.032707:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695823360:0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.032805:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190715.032854:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190715.032860:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695823872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.032887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190715.032920:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695823488:0@lo:38:kworker.0 00000100:00100000:1.0:1787190715.032945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190715.032976:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695823616:0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.032999:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190715.033017:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190715.033022:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695823744:0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.033043:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190715.033075:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823360 00000100:00100000:1.0:1787190715.033083:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823360 00000100:00100000:1.0:1787190715.033131:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190715.033140:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3654:x1874004695823360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.033188:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3654:x1874004695823360:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190715.033194:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190715.033227:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823872 00000100:00100000:1.0:1787190715.033231:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823872 00000100:00100000:1.0:1787190715.033252:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823616 00000100:00100000:1.0:1787190715.033255:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823616 00000100:00100000:1.0:1787190715.033268:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190715.033274:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695823872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.033328:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695823872:12345-0@lo:400:kworker.0 Request processed in 54us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190715.033334:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190715.033354:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190715.033360:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695823616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.033399:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695823616:12345-0@lo:400:kworker.0 Request processed in 40us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190715.033404:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190715.033421:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823488 00000100:00100000:1.0:1787190715.033424:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823488 00000100:00100000:1.0:1787190715.033435:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695823744 00000100:00100000:1.0:1787190715.033437:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695823744 00000100:00100000:1.0:1787190715.033450:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190715.033454:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3650:x1874004695823488:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787190715.033478:0:22764:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 692 last 0 00000020:00000080:1.0:1787190715.033511:0:22764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb4b7c 00000004:00100000:1.0:1787190715.033526:0:22764:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1787190715.033531:0:22764:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:1.0:1787190715.033655:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f17d99ed80 x1874004695823872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190715.033670:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695823872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190715.033680:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695823360:0@lo:400:kworker.0 00010000:00080000:2.0:1787190715.033722:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f15ffa8e00 x1874004695823616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190715.033733:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695823616:0@lo:400:kworker.0 00000100:00100000:2.0:1787190715.034239:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190715.034251:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695824000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190715.034318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190715.034672:0:22763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1787190715.034681:0:22763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1787190715.036547:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824000 00000100:00100000:2.0:1787190715.036558:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824000 00000100:00100000:0.0:1787190715.036820:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190715.036833:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695823744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190715.036952:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695823744:12345-0@lo:400:kworker.0 Request processed in 121us (3906us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190715.036959:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190715.036978:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787190715.036984:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695824000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787190715.037009:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787190715.037043:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695824000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (2725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190715.037049:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190715.037253:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695824000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190715.037323:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695823744:0@lo:400:kworker.0 00000100:00080000:3.0:1787190715.053068:0:22764:0:(import.c:65:import_set_state_nolock()) ffff99f15e489800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190715.053168:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874004695823488:12345-0@lo:38:kworker.0 Request processed in 19710us (20219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190715.053181:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787190715.053240:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787190715.053251:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1787190715.053256:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787190715.053267:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d08d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1787190715.053282:0:3650:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009df2385c): req@ffff99f1666cea00 x1874004695816192/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190715.053316:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695823488:0@lo:38:kworker.0 00000100:00100000:3.0:1787190715.053417:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190715.053439:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c75b240 going to sleep for 11 seconds 00000100:00100000:3.0:1787190715.053451:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787190715.053461:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695824128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787190715.053486:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190715.053517:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695816192 00000100:00100000:3.0:1787190715.053523:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695816192 00000100:00100000:3.0:1787190715.053558:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824128 00000100:00100000:3.0:1787190715.053562:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824128 00000100:00100000:3.0:1787190715.053577:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787190715.053585:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22800:x1874004695816192:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.053663:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22800:x1874004695816192:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190715.053671:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787190715.053686:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787190715.053704:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874004695824128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190715.053725:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190715.053761:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1874004695824128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190715.053767:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787190715.053796:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695824128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787190715.053819:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1874004695816192:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1787190715.053864:0:22800:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1787190715.053895:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1874004695824256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.053924:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190715.053937:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190715.053949:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824256 00000100:00100000:3.0:1787190715.053952:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824256 00000100:00100000:3.0:1787190715.053968:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787190715.053973:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1874004695824256:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.054072:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1874004695824256:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190715.054078:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787190715.054102:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1874004695824256:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.054166:0:22800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1874004695824384:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.054188:0:22800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190715.054202:0:22800:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1602bc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190715.054213:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824384 00000100:00100000:3.0:1787190715.054216:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824384 00000100:00100000:3.0:1787190715.054233:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190715.054238:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1874004695824384:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1787190715.054283:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22800:x1874004695824384:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 44us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190715.054313:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190715.054336:0:22800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22800:1874004695824384:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1787190715.054374:0:22800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190715.061047:0:22800:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787190715.061143:0:22800:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:3.0:1787190715.061148:0:22800:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787190715.154502:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1787190715.940439:0:23812:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1787190715.941244:0:23812:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787190716.179521:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787190716.767717:0:23862:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190716.768195:0:23862:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1787190717.204374:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787190717.801220:0:23910:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7d0e4da0 20000000:00000080:0.0:1787190717.801249:0:23910:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99f15fff6c00 uarg=0000000000000000 20000000:01000000:0.0:1787190717.801421:0:23910:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787190717.801429:0:23910:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787190717.801433:0:23910:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787190717.801969:0:23911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1787190717.802136:0:23910:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787190717.808472:0:23910:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787190717.808506:0:23910:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808527:0:23910:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808536:0:23910:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808543:0:23910:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808587:0:23910:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808605:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190717.808690:0:23910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1874004695824512:0@lo:104: 00000100:00100000:0.0:1787190717.808761:0:23910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787190717.808932:0:23910:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.808941:0:23910:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 17 pid: 22752 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190717.808970:0:23910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1874004695824640:0@lo:104: 00000100:00100000:0.0:1787190717.808993:0:23910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190717.809106:0:23910:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e43a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190717.809191:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824512 00000100:00100000:1.0:1787190717.809200:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824512 00000100:00100000:1.0:1787190717.809246:0:22742:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824640 00000100:00100000:1.0:1787190717.809249:0:22742:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824640 00000100:00100000:1.0:1787190717.809263:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190717.809271:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:23910:x1874004695824512:12345-0@lo:104: 00010000:00010000:1.0:1787190717.809317:0:22742:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809388:0:22742:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190717.809394:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:23910:x1874004695824512:12345-0@lo:104: Request processed in 124us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190717.809402:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190717.809420:0:22742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190717.809427:0:22742:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:23910:x1874004695824640:12345-0@lo:104: 00010000:00010000:1.0:1787190717.809434:0:22742:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809466:0:22742:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787190717.809471:0:22742:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:23910:x1874004695824640:12345-0@lo:104: Request processed in 46us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190717.809476:0:22742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787190717.809492:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190717.809498:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809505:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4000 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190717.809509:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809518:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190717.809525:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190717.809531:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787190717.809567:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809574:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190717.809594:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809601:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b4000/0xdedcc04674eb4b28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b2f expref: -99 pid: 23490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809693:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190717.809697:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809704:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4c00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190717.809707:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809714:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190717.809721:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190717.809726:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787190717.809740:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809746:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190717.809762:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190717.809878:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190717.809934:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b4c00/0xdedcc04674eb4a25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4a2c expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.809947:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190717.809948:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190717.809950:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190717.809971:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695824768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190717.810004:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190717.810049:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190717.810056:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695824896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190717.810080:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190717.810104:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824768 00000100:00100000:1.0:1787190717.810109:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824768 00010000:00010000:1.0:1787190717.810126:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 18 pid: 22753 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190717.810146:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695824896 00000100:00100000:1.0:1787190717.810149:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695824896 00010000:00010000:1.0:1787190717.810160:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 19 pid: 22752 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190717.810172:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190717.810179:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:3652:x1874004695824768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190717.810189:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190717.810195:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 19 pid: 22753 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810205:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 19 pid: 22753 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810229:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190717.810256:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:3652:x1874004695824768:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190717.810263:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190717.810276:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787190717.810282:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3654:x1874004695824896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190717.810452:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190717.810457:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 18 pid: 22752 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810465:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 18 pid: 22752 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810476:0:22746:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810484:0:22746:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810497:0:22746:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810503:0:22746:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810511:0:22746:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810517:0:22746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810527:0:22746:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bb200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190717.810532:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810539:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810547:0:22746:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190717.810556:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190717.810582:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3654:x1874004695824896:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190717.810588:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787190717.810754:0:23910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667ba000/0xdedcc04674eb4b2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b28 expref: 17 pid: 22753 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190717.810766:0:23910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1874004695824512:0@lo:104: 00010000:00010000:0.0:1787190717.810785:0:23910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039e800/0xdedcc04674eb4a2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4a25 expref: 16 pid: 22752 timeout: 794 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190717.810792:0:23910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23910:1874004695824640:0@lo:104: 00010000:00010000:0.0:1787190717.810810:0:23910:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.810818:0:23910:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.810824:0:23910:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190717.810829:0:23910:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4b83 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23910 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190717.812374:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695824896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190717.812835:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695824768:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190718.226437:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190718.483006:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787190719.128373:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190709/real 1787190709] req@ffff99f17cdf5f80 x1874004695819392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190719.128403:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17cdf5f80 x1874004695819392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190719.128414:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190709/real 1787190709] req@ffff99f17cdf5500 x1874004695819264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190719 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190719.128425:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17cdf5500 x1874004695819264/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190719 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190719.128445:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190719.128832:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190719.128837:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695819392:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787190719.128844:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f158353000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190719.129185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.129189:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190719.129202:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.129205:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190719.129235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.129238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787190719.129241:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f158353000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190719.129246:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:2.0:1787190719.129252:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787190719.129258:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99f158353000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190719.129279:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cf800 x1874004695825536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190719.129316:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.129319:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787190719.129320:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190719.129323:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:2.0:1787190719.129326:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787190719.129329:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99f143e76000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190719.129342:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cdf80 x1874004695825664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190719.129380:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695825408:0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.129448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190719.129484:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787190719.129490:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695825024:0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.129519:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190719.129545:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695825792:0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.129793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190719.129828:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825408 00000100:00100000:2.0:1787190719.129837:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825408 00000100:00100000:2.0:1787190719.129885:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787190719.129895:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695825408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.130075:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695825408:12345-0@lo:400:kworker.0 Request processed in 181us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.130083:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787190719.130108:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825024 00000100:00100000:2.0:1787190719.130112:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825024 00000100:00100000:2.0:1787190719.130137:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787190719.130144:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:3653:x1874004695825024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.130174:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:3653:x1874004695825024:12345-0@lo:400:kworker.0 Request processed in 31us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.130181:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787190719.130320:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695825024:0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.130338:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695825408:0@lo:400:kworker.0 00000100:00100000:0.0:1787190719.130746:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695825280:0@lo:400:kworker.0 00000100:00100000:0.0:1787190719.130790:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190719.130810:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190719.130816:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695825152:0@lo:400:kworker.0 00000100:00100000:0.0:1787190719.130851:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190719.130897:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825792 00000100:00100000:0.0:1787190719.130902:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825792 00000100:00100000:0.0:1787190719.130927:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825280 00000100:00100000:0.0:1787190719.130929:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825280 00000100:00100000:0.0:1787190719.130954:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190719.130960:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695825792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190719.131001:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695825792:12345-0@lo:400:kworker.0 Request processed in 40us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190719.131007:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190719.131019:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190719.131024:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695825280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190719.131051:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695825280:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190719.131056:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787190719.131083:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f1666ced80 x1874004695825280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190719.131093:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695825280:0@lo:400:kworker.0 00010000:00080000:0.0:1787190719.131117:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f1666ce680 x1874004695825792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190719.131126:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695825792:0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.131551:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825152 00000100:00100000:2.0:1787190719.132706:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825152 00000100:00100000:2.0:1787190719.132760:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787190719.132768:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874004695825152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190719.132836:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1874004695825152:12345-0@lo:400:kworker.0 Request processed in 69us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.132842:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787190719.132886:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695825152:0@lo:400:kworker.0 00000100:00080000:3.0:1787190719.134363:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190719.134374:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695819264:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787190719.134413:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695825536:0@lo:8:kworker.0 00000400:00000100:3.0:1787190719.134463:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695825536 offset 0 length 520: 4 00000100:00100000:3.0:1787190719.134492:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695825664:0@lo:8:kworker.0 00000400:00000100:3.0:1787190719.134511:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695825664 offset 0 length 520: 4 00000100:00080000:2.0:1787190719.135054:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.135059:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190719.135062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190719.135065:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787190719.254451:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787190719.766922:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787190719.766930:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f144dc0000 from 13 10000000:01000000:3.0:1787190719.766935:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787190719.766983:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.766996:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.767007:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190719.767032:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695825920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.767099:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190719.767152:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1466b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190719.767221:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695825920 00000100:00100000:2.0:1787190719.767229:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695825920 00000100:00100000:2.0:1787190719.767283:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787190719.767311:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+16:22756:x1874004695825920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190719.767324:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190719.767338:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b8a expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.767361:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.767371:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 17 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.767380:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039ea00, rc 0) 00000100:00100000:2.0:1787190719.767414:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695825920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.767420:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787190719.767501:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695825920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190719.767514:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.767523:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190719.767576:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.767598:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190719.767634:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1466b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190719.767733:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826048 00000100:00100000:2.0:1787190719.767737:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826048 00000100:00100000:2.0:1787190719.767760:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787190719.767766:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695826048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190719.767879:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695826048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.767886:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787190719.767941:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.767970:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.768004:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190719.768024:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1466b0540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190719.768071:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826176 00000100:00100000:2.0:1787190719.768076:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826176 00000100:00100000:2.0:1787190719.768105:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787190719.768112:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695826176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190719.768184:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695826176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190719.768191:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787190719.768264:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787190719.769165:0:24002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1787190719.769791:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1787190719.769814:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787190719.769824:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.769837:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190719.769850:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787190719.769853:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f15e512000 from 13 10000000:01000000:2.0:1787190719.769855:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190719.769884:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.769891:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.769901:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190719.769931:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787190719.769979:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190719.770006:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f146679600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190719.770055:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826304 00000100:00100000:3.0:1787190719.770062:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826304 00000100:00100000:3.0:1787190719.770107:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787190719.770116:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+17:22756:x1874004695826304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190719.770128:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190719.770141:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4b98 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.770431:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.770442:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 18 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190719.770451:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d10800, rc 0) 00000100:00100000:3.0:1787190719.770496:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695826304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 382us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190719.770503:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787190719.770572:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190719.770586:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190719.770596:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190719.770662:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190719.770687:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190719.770711:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f146679600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190719.770802:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826432 00000100:00100000:3.0:1787190719.770807:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826432 00000100:00100000:3.0:1787190719.770844:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787190719.770850:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695826432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.770950:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695826432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190719.770957:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787190719.771558:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190719.771594:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190719.771639:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190719.771679:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16081d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190719.771734:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826560 00000100:00100000:3.0:1787190719.771740:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826560 00000100:00100000:3.0:1787190719.771774:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787190719.771783:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695826560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190719.771885:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:22756:x1874004695826560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190719.771893:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787190719.771915:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695826560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787190719.772835:0:24003:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1787190719.773326:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1787190719.773349:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787190719.773360:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190719.773378:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190720.147198:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190720.147222:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695826688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190720.147307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190720.147550:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826688 00000100:00100000:0.0:1787190720.147564:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826688 00000100:00100000:0.0:1787190720.147610:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787190720.147619:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695826688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1787190720.147674:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1787190720.147725:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695826688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190720.147732:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190720.147891:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695826688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787190720.147990:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190705/real 1787190705] req@ffff99f15ffaad80 x1874004695817216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190720.148009:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f15ffaad80 x1874004695817216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190720.148017:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190705/real 1787190705] req@ffff99f15ffab480 x1874004695817344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190720 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190720.148027:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f15ffab480 x1874004695817344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190720 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190720.148040:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190720.148063:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190720.148067:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817216:0@lo:8:kworker.0 00000100:00080000:3.0:1787190720.148079:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190720.148084:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190720.148087:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695817344:0@lo:8:kworker.0 00000100:00080000:1.0:1787190720.148379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190720.148384:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787190720.148387:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190720.148392:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:1.0:1787190720.148398:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787190720.148403:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99f15ffbd000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190720.148421:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17d99ea00 x1874004695827200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190720.148434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190720.148437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787190720.148439:0:37:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190720.148444:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 682 00000100:00080000:1.0:1787190720.148447:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787190720.148450:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99f17c31d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:0.0:1787190720.148452:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695827200:0@lo:8:kworker.0 00000100:00100000:1.0:1787190720.148463:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17d99d180 x1874004695827328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787190720.148476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190720.148480:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:0.0:1787190720.148480:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695827200 offset 0 length 520: 4 00000100:00080000:1.0:1787190720.148483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190720.148491:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787190720.148505:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695827328:0@lo:8:kworker.0 00000400:00000100:0.0:1787190720.148523:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874004695827328 offset 0 length 520: 4 00000100:00100000:1.0:1787190720.148526:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695827456:0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148556:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190720.148585:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190720.148591:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695826816:0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148617:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190720.148638:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874004695827584:0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190720.148671:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826816 00000100:00100000:3.0:1787190720.148678:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826816 00000100:00100000:1.0:1787190720.148697:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695826944:0@lo:400:kworker.0 00000100:00100000:3.0:1787190720.148729:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787190720.148734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190720.148754:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3651:x1874004695826816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190720.148786:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827456 00000100:00100000:0.0:1787190720.148791:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827456 00000100:00100000:3.0:1787190720.148808:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:3651:x1874004695826816:12345-0@lo:400:kworker.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190720.148816:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787190720.148821:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827584 00000100:00100000:0.0:1787190720.148826:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827584 00000100:00100000:1.0:1787190720.148831:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190720.148838:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695827072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190720.148845:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190720.148852:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695827456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190720.148894:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695827456:12345-0@lo:400:kworker.0 Request processed in 43us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190720.148898:0:22760:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787190720.148900:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787190720.148905:0:22760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1787190720.148912:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190720.148918:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874004695827584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148920:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695826944 00000100:00100000:1.0:1787190720.148923:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695826944 00000100:00100000:0.0:1787190720.148944:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874004695827584:12345-0@lo:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190720.148945:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827072 00000100:00100000:1.0:1787190720.148948:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827072 00000100:00100000:0.0:1787190720.148950:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190720.148958:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787190720.148970:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1874004695826944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.148975:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787190720.148985:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3653:x1874004695827072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787190720.149009:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190720.149027:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3653:x1874004695826944:12345-0@lo:400:kworker.0 Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190720.149035:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190720.149050:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1874004695827072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 66us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190720.149058:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787190720.149081:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695827072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190720.149101:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695826944:0@lo:400:kworker.0 00000100:00100000:1.0:1787190720.149142:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695826816:0@lo:400:kworker.0 00010000:00080000:1.0:1787190720.149161:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f17d99c380 x1874004695827584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190720.149171:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874004695827584:0@lo:400:kworker.0 00010000:00080000:1.0:1787190720.149180:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f17d99dc00 x1874004695827456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190720.149187:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695827456:0@lo:400:kworker.0 00010000:00010000:3.0:1787190720.276102:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787190720.665683:0:23491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1787190721.112410:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787190721.300453:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190722.328200:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190723.346386:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190724.372539:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787190724.417796:0:24259:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787190724.417800:0:24259:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1787190724.417802:0:24259:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787190724.417916:0:24259:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99f17c59d800 00000020:01000004:1.0:1787190724.417934:0:24259:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787190724.417948:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787190724.417962:0:24259:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99f17c133370) 00000020:00000080:1.0:1787190724.417979:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1787190724.462417:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1787190724.464880:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1787190724.465338:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1787190724.465571:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1787190724.465887:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1787190724.466212:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1787190724.466475:0:24259:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:2.0:1787190724.470016:0:24259:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1787190724.470224:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787190724.470238:0:24259:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787190724.470253:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdedcc04674eb4bad 00000020:01000004:2.0:1787190724.470261:0:24259:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1787190724.470282:0:24259:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787190724.470331:0:24259:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787190724.470337:0:24259:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787190724.470343:0:24259:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787190724.470355:0:24259:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99f166408000) 00000020:00000080:2.0:1787190724.470366:0:24259:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1787190724.471556:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787190724.471717:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787190724.471723:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787190724.472643:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787190724.472651:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787190724.483140:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787190724.483153:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787190724.485217:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190724.485504:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787190724.485510:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787190724.486459:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787190724.486467:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787190724.504217:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787190724.504677:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787190724.504685:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787190724.507459:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787190724.507618:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787190724.508550:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787190724.508622:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787190724.511960:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190724.512191:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787190724.512198:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787190724.512999:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787190724.513007:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787190724.554254:0:24259:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787190724.554762:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787190724.554769:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787190724.556423:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787190724.556434:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787190724.557689:0:24259:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787190724.557793:0:24259:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1787190724.557802:0:24259:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787190724.571677:0:24259:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787190724.571711:0:24259:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.122@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787190724.571716:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787190724.571718:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190724.571719:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190724.571720:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190724.571722:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190724.571723:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190724.571724:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190724.571726:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190724.571727:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190724.571731:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787190724.571733:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190724.571734:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190724.571735:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190724.571736:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190724.571737:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190724.571743:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190724.571744:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190724.571745:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190724.571746:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787190724.571775:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787190724.571801:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827712:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787190724.571869:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.571907:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378900 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.572013:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827712 00000100:00100000:3.0:1787190724.572020:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827712 00000100:00100000:3.0:1787190724.572069:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787190724.572076:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:24259:x1874004695827712:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787190724.572100:0:22753:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787190724.572102:0:22753:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787190724.572105:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787190724.572500:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:24259:x1874004695827712:12345-0@lo:253:mount.lustre.0 Request processed in 423us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.572509:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787190724.572640:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827712:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787190724.572650:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787190724.572652:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787190724.572653:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190724.572654:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190724.572655:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190724.572656:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190724.572657:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190724.572658:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190724.572660:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190724.572661:0:24259:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787190724.572677:0:24259:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99f17c59d800 from lustre-OST0000 10000000:01000000:1.0:1787190724.572703:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1787190724.572705:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787190724.572721:0:24259:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99f1794b99b8 local copy 00010000:00010000:1.0:1787190724.572732:0:24259:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190724.572807:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827840:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190724.572849:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.572916:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1588689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.574546:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827840 00000100:00100000:2.0:1787190724.574672:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827840 00000100:00100000:2.0:1787190724.574838:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787190724.574850:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:24259:x1874004695827840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190724.574995:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:24259:x1874004695827840:12345-0@lo:501:mount.lustre.0 Request processed in 148us (2145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190724.575003:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787190724.575080:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827840:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787190724.575102:0:24259:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787190724.575124:0:24259:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787190724.575143:0:24259:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.575153:0:24259:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190724.575183:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99f17c59d800 10000000:01000000:1.0:1787190724.575187:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787190724.575193:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787190724.575195:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787190724.575199:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787190724.575201:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787190724.575226:0:24259:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.575233:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.575242:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190724.575259:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827968:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190724.575321:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.575704:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1588689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.575911:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695827968 00000100:00100000:3.0:1787190724.575926:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695827968 00000100:00100000:3.0:1787190724.575954:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787190724.575961:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+18:24259:x1874004695827968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190724.575970:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190724.575983:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d11a00/0xdedcc04674eb4bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4bbb expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.576007:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11a00/0xdedcc04674eb4bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4bbb expref: 19 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.576017:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d11a00/0xdedcc04674eb4bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4bbb expref: 19 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.576025:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d11a00, rc 0) 00000100:00100000:3.0:1787190724.576065:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695827968:12345-0@lo:101:mount.lustre.0 Request processed in 104us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.576079:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787190724.576498:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695827968:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190724.576513:0:24259:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bc2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.576522:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4bc2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190724.578793:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:1.0:1787190724.579515:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787190724.585005:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1787190724.585074:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1787190724.585090:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1787190724.585103:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1787190724.585634:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1787190724.585666:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1787190724.585682:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1787190724.585695:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1787190724.585707:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1787190724.585720:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1787190724.585734:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1787190724.585747:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1787190724.585779:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1787190724.585786:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1787190724.585892:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190724.585961:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.586258:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.586773:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828096 00000100:00100000:3.0:1787190724.586781:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828096 00000100:00100000:3.0:1787190724.586838:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787190724.586848:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190724.587046:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828096:12345-0@lo:501:mount.lustre.0 Request processed in 199us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.587055:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787190724.587244:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828096:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190724.587281:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828224:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190724.587438:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.587496:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190724.587530:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828224 00000100:00100000:0.0:1787190724.587536:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828224 00000100:00100000:0.0:1787190724.587637:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787190724.587645:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190724.588505:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828224:12345-0@lo:503:mount.lustre.0 Request processed in 858us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.588514:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787190724.588648:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828224:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190724.589125:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190724.589268:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828352:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190724.589457:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.589535:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1588689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.589633:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828352 00000100:00100000:3.0:1787190724.589639:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828352 00000100:00100000:3.0:1787190724.589720:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787190724.589728:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190724.590116:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828352:12345-0@lo:502:mount.lustre.0 Request processed in 387us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.590123:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787190724.590204:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828352:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190724.590410:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1787190724.590436:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1787190724.590448:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1787190724.590459:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1787190724.590471:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1787190724.590500:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1787190724.590515:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1787190724.590528:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1787190724.590541:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1787190724.590565:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1787190724.590581:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1787190724.590593:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1787190724.590626:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828480:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190724.590662:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.591097:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1588689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.591284:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828480 00000100:00100000:2.0:1787190724.591312:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828480 00000100:00100000:2.0:1787190724.591344:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787190724.591487:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190724.591690:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828480:12345-0@lo:502:mount.lustre.0 Request processed in 208us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.591697:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787190724.591776:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828480:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190724.591834:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1787190724.591843:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1787190724.592875:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787190724.592885:0:24276:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1787190724.592892:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787190724.592900:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787190724.592906:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787190724.592922:0:24276:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99f1667cb370) 00000020:00000080:2.0:1787190724.592946:0:24276:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787190724.592952:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787190724.593108:0:24276:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f17c59d800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787190724.593117:0:24276:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787190724.593124:0:24276:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdedcc04674eb4bd0 00010000:00010000:2.0:1787190724.593628:0:24276:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1787190724.594126:0:24276:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1787190724.598479:0:24276:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1787190724.600397:0:24276:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787190724.600410:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190724.600417:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600419:0:24276:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787190724.600422:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787190724.600425:0:24276:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1787190724.600432:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787190724.600434:0:24276:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787190724.600435:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787190724.600437:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600438:0:24276:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787190724.600441:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190724.600443:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600445:0:24276:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787190724.600447:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787190724.600449:0:24276:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787190724.600451:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190724.600452:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600453:0:24276:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787190724.600455:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787190724.600457:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600458:0:24276:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787190724.600460:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787190724.600492:0:24276:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787190724.600495:0:24276:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787190724.600496:0:24276:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787190724.600499:0:24276:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1787190724.603201:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787190724.603248:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787190724.603282:0:24259:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bc2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.603310:0:24259:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5800/0xdedcc04674eb4bbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bc2 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190724.603320:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f17c59d800 from 1 10000000:01000000:2.0:1787190724.603322:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787190724.603361:0:24259:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.603369:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.603380:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190724.603406:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828608:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787190724.603486:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190724.603533:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f160126000 going to sleep for 11 seconds 00000100:00100000:0.0:1787190724.604472:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828608 00000100:00100000:0.0:1787190724.604482:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828608 00000100:00100000:0.0:1787190724.604532:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787190724.604542:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:24259:x1874004695828608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787190724.604682:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190724.604698:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4bd7 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.604724:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.604734:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 20 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.604752:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bb600, rc 0) 00000100:00100000:0.0:1787190724.604972:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828608:12345-0@lo:101:mount.lustre.0 Request processed in 431us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.604980:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787190724.615643:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190724.615675:0:24259:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.615693:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190724.617897:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787190724.618171:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190724.618386:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787190724.618421:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787190724.618445:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787190724.618459:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787190724.618470:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787190724.618481:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787190724.618491:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787190724.618504:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787190724.618515:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787190724.618526:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787190724.618538:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787190724.618576:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787190724.618582:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787190724.618732:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190724.619194:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190724.619234:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15095c540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.619244:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828736 00000100:00100000:2.0:1787190724.619251:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828736 00000100:00100000:2.0:1787190724.619366:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787190724.619378:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828736:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190724.619518:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828736:12345-0@lo:501:mount.lustre.0 Request processed in 142us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.619527:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787190724.619633:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190724.619682:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190724.619725:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.619752:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.619763:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828864 00000100:00100000:2.0:1787190724.619769:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828864 00000100:00100000:2.0:1787190724.619834:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787190724.619853:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828864:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190724.619941:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828864:12345-0@lo:503:mount.lustre.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.619948:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787190724.620019:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190724.620445:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190724.620516:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190724.620550:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.620955:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868780 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.621242:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695828992 00000100:00100000:3.0:1787190724.621249:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695828992 00000100:00100000:3.0:1787190724.621278:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787190724.623011:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828992:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190724.623508:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695828992:12345-0@lo:502:mount.lustre.0 Request processed in 2220us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.623518:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787190724.623706:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695828992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190724.624110:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1787190724.624211:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1787190724.624228:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1787190724.624240:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1787190724.624253:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1787190724.624265:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1787190724.624277:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1787190724.624379:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1787190724.624396:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1787190724.624410:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1787190724.624423:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1787190724.624455:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190724.624501:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.624539:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868780 going to sleep for 11 seconds 00000100:00100000:0.0:1787190724.624540:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829120 00000100:00100000:0.0:1787190724.624547:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829120 00000100:00100000:0.0:1787190724.624618:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787190724.624626:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695829120:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190724.624726:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695829120:12345-0@lo:502:mount.lustre.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.624731:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787190724.624756:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190724.624909:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1787190724.624917:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1787190724.625740:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190724.625750:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.625752:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787190724.625758:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f17c59d800 00000020:00000080:1.0:1787190724.625761:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190724.625769:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190724.625771:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.625773:0:24280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787190724.625884:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190724.625889:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.625890:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787190724.625894:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f17c59d800 00000020:00000080:1.0:1787190724.625896:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190724.625950:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190724.625954:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.625956:0:24280:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787190724.625959:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190724.625962:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.625963:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787190724.625967:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f17c59d800 00000020:00000080:1.0:1787190724.625970:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190724.626002:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190724.626005:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.626007:0:24280:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787190724.626009:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787190724.626012:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.626013:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1787190724.626016:0:24280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f17c59d800 00000020:00000080:1.0:1787190724.626018:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787190724.626114:0:24280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787190724.626118:0:24280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787190724.626119:0:24280:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1787190724.626122:0:24280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787190724.626379:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787190724.626407:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190724.626452:0:24259:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626465:0:24259:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190724.626519:0:24259:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787190724.626527:0:24259:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99f17c59d800 10000000:01000000:3.0:1787190724.626530:0:24259:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99f17c59d800 10000000:01000000:3.0:1787190724.626535:0:24259:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787190724.626540:0:24259:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99f17c59d800 from 1 10000000:01000000:3.0:1787190724.626543:0:24259:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787190724.626573:0:24259:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626582:0:24259:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626592:0:24259:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190724.626626:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787190724.626673:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190724.626705:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829248 00000100:00100000:3.0:1787190724.626710:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829248 00000100:00100000:3.0:1787190724.626744:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190724.626754:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695829248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190724.626765:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190724.626776:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f154d11c00/0xdedcc04674eb4bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4be5 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626809:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11c00/0xdedcc04674eb4bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4be5 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626819:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f154d11c00/0xdedcc04674eb4bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4be5 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626839:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f154d11c00, rc 0) 00000100:00100000:3.0:1787190724.626878:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829248:12345-0@lo:101:mount.lustre.0 Request processed in 126us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.626885:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787190724.626922:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15095c180 going to sleep for 11 seconds 00000100:00100000:3.0:1787190724.626940:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190724.626953:0:24259:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bec expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.626962:0:24259:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4bec expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190724.640942:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1787190724.641266:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190724.642639:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1787190724.642696:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1787190724.642787:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1787190724.642806:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1787190724.642819:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1787190724.642833:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1787190724.643161:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1787190724.643181:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1787190724.643199:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1787190724.643216:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1787190724.643234:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1787190724.643251:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1787190724.643265:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1787190724.643279:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1787190724.645412:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1787190724.645436:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1787190724.645449:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1787190724.645460:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1787190724.645474:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1787190724.645486:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1787190724.645497:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1787190724.645512:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1787190724.645543:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1787190724.645564:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1787190724.645579:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1787190724.645605:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1787190724.645644:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1787190724.645659:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1787190724.645674:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1787190724.645691:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1787190724.645705:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1787190724.645719:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1787190724.645735:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1787190724.645750:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1787190724.645764:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1787190724.645787:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1787190724.645805:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1787190724.645821:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1787190724.646047:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1787190724.646067:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1787190724.646080:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1787190724.646092:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1787190724.646106:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1787190724.646120:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1787190724.646271:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1787190724.646318:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1787190724.646338:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1787190724.646359:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1787190724.646562:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1787190724.646587:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1787190724.647116:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1787190724.647122:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1787190724.647687:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190724.647760:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.648117:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829376 00000100:00100000:1.0:1787190724.648125:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829376 00000100:00100000:1.0:1787190724.648240:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787190724.648250:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787190724.648454:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829376:12345-0@lo:501:mount.lustre.0 Request processed in 205us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190724.648462:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787190724.648893:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f160126c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.648917:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190724.648958:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190724.649003:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190724.649019:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f160126c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.649046:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829504 00000100:00100000:2.0:1787190724.649051:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829504 00000100:00100000:2.0:1787190724.649084:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787190724.649092:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829504:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190724.649448:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829504:12345-0@lo:503:mount.lustre.0 Request processed in 356us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.649455:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787190724.649538:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787190724.650270:0:24259:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787190724.650370:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190724.650417:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.650443:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.650503:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829632 00000100:00100000:2.0:1787190724.650509:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829632 00000100:00100000:2.0:1787190724.650545:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787190724.650554:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190724.650709:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829632:12345-0@lo:502:mount.lustre.0 Request processed in 156us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.650717:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787190724.650873:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787190724.651230:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1787190724.651256:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1787190724.651276:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1787190724.651323:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1787190724.651339:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1787190724.651354:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1787190724.651370:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1787190724.651385:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1787190724.651400:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1787190724.651418:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1787190724.651434:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1787190724.651464:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1787190724.651483:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1787190724.651497:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1787190724.651512:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1787190724.651528:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1787190724.651541:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1787190724.651555:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1787190724.651570:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1787190724.651585:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1787190724.652323:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1787190724.652449:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1787190724.652478:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1787190724.652495:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1787190724.652508:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1787190724.652521:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1787190724.652533:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1787190724.652544:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1787190724.652634:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1787190724.652650:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1787190724.652663:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1787190724.652676:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1787190724.652687:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1787190724.652698:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1787190724.652777:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1787190724.652795:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1787190724.652808:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1787190724.652821:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1787190724.652847:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1787190724.652860:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1787190724.652873:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1787190724.652886:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1787190724.652899:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1787190724.652912:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1787190724.653260:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1787190724.653279:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1787190724.653314:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1787190724.653330:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1787190724.653448:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829760:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190724.653525:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190724.653622:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829760 00000100:00100000:2.0:1787190724.653630:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829760 00000100:00100000:3.0:1787190724.653638:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14630b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.653677:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787190724.653686:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190724.653808:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829760:12345-0@lo:502:mount.lustre.0 Request processed in 124us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.653816:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787190724.653824:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190724.654408:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1787190724.654437:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1787190724.654465:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190724.654503:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190724.654532:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14630b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190724.654557:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695829888 00000100:00100000:2.0:1787190724.654562:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695829888 00000100:00100000:2.0:1787190724.654665:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787190724.654673:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190724.654755:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695829888:12345-0@lo:502:mount.lustre.0 Request processed in 83us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.654763:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787190724.654803:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695829888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190724.654844:0:24259:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1787190724.654852:0:24259:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1787190724.657430:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787190724.657447:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99f14866b370) 00000020:00000080:3.0:1787190724.657474:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1787190724.657582:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f17c59d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787190724.657585:0:24286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f17c59d800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787190724.657587:0:24286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f17c59d800 3 00010000:00080000:3.0:1787190724.657623:0:24286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f170112800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:3.0:1787190724.657753:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1787190724.657920:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1787190724.657941:0:24286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787190724.657961:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdedcc04674eb4bfa 00000100:00080000:3.0:1787190724.657969:0:24286:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787190724.657973:0:24286:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99f170112800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:3.0:1787190724.658009:0:24286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17cdf5f80 x1874004695830016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787190724.658040:0:24286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787190724.658084:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695830016:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787190724.658172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190724.658283:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830016 00000100:00100000:3.0:1787190724.658310:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830016 00000100:00100000:3.0:1787190724.658350:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787190724.658366:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3650:x1874004695830016:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787190724.658394:0:22758:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:01000004:2.0:1787190724.658410:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787190724.658421:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff99f1667c99b8) 00000020:00000080:3.0:1787190724.658430:0:22758:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdedcc04674eb4c01 00000020:00000080:2.0:1787190724.658432:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000004:00100000:3.0:1787190724.658446:0:22758:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787190724.658472:0:22758:0:(import.c:65:import_set_state_nolock()) ffff99f158792000 : changing import state from RECOVER to FULL 00000020:01000004:2.0:1787190724.658504:0:24286:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f17c59d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190724.658507:0:24286:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f17c59d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787190724.658509:0:24286:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f17c59d800 3 00000100:00100000:3.0:1787190724.658531:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1874004695830016:12345-0@lo:38:llog_process_th.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.658538:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787190724.658548:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f17cdf5f80 x1874004695830016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190724.658560:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787190724.658568:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1787190724.658574:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787190724.658578:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787190724.658580:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f170112800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787190724.658587:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3650:1874004695830016:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787190724.658681:0:24286:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f1587fb000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787190724.658810:0:24286:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1787190724.658949:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1787190724.658972:0:24286:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190724.658978:0:24286:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdedcc04674eb4c0f 00000100:00080000:2.0:1787190724.658983:0:24286:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190724.658987:0:24286:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff99f1587fb000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190724.659009:0:24286:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cc000 x1874004695830144/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190724.659031:0:24286:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1787190724.659151:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1787190724.659240:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874004695830144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787190724.659273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190724.659358:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830144 00000100:00100000:2.0:1787190724.659364:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830144 00000100:00100000:2.0:1787190724.659396:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190724.659403:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695830144:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787190724.659421:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 701 last 0 00000020:00000080:2.0:1787190724.659445:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdedcc04674eb4c16 00000004:00100000:2.0:1787190724.659455:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787190724.659471:0:22760:0:(import.c:65:import_set_state_nolock()) ffff99f1587f9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787190724.659517:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1874004695830144:12345-0@lo:38:llog_process_th.0 Request processed in 114us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190724.659523:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787190724.659646:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f1666cc000 x1874004695830144/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190724.659654:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190724.659658:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1787190724.659662:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787190724.659666:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1787190724.659668:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f1587fb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787190724.659672:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3650:1874004695830144:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787190724.660513:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695830272:0@lo:400:kworker.0 00000100:00100000:3.0:1787190724.660563:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787190724.661779:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190724.661787:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190724.661790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190724.661794:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787190724.661819:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787190724.661831:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874004695830400:0@lo:400:kworker.0 00000100:00080000:0.0:1787190724.661841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190724.661846:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787190724.661849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787190724.661852:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787190724.661882:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190724.661926:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874004695830656:0@lo:400:kworker.0 00000100:00100000:0.0:1787190724.661964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190724.661989:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190724.662006:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695830528:0@lo:400:kworker.0 00000100:00100000:0.0:1787190724.662036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190724.662067:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830272 00000100:00100000:0.0:1787190724.662069:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830400 00000100:00100000:0.0:1787190724.662075:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830400 00000100:00100000:3.0:1787190724.662076:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830272 00000100:00100000:0.0:1787190724.662125:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830656 00000100:00100000:3.0:1787190724.662127:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830528 00000100:00100000:0.0:1787190724.662131:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830656 00000100:00100000:3.0:1787190724.662133:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830528 00000100:00100000:3.0:1787190724.662158:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787190724.662165:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190724.662168:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695830272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190724.662177:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874004695830400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190724.662232:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695830272:12345-0@lo:400:kworker.0 Request processed in 65us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.662241:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787190724.662242:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874004695830400:12345-0@lo:400:kworker.0 Request processed in 66us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.662253:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787190724.662262:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787190724.662269:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695830528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190724.662275:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190724.662306:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874004695830656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190724.662324:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695830528:12345-0@lo:400:kworker.0 Request processed in 55us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.662331:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787190724.662358:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874004695830656:12345-0@lo:400:kworker.0 Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.662367:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190724.662411:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695830528:0@lo:400:kworker.0 00010000:00080000:0.0:1787190724.662424:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f1483fea00 x1874004695830656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190724.662433:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874004695830656:0@lo:400:kworker.0 00010000:00080000:3.0:1787190724.662445:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99f1483ffb80 x1874004695830400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190724.662457:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874004695830400:0@lo:400:kworker.0 00000100:00100000:3.0:1787190724.662469:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695830272:0@lo:400:kworker.0 00000020:01000000:1.0:1787190724.662876:0:24259:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1787190724.662921:0:24259:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787190724.662939:0:24259:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bec expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.662957:0:24259:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d10600/0xdedcc04674eb4be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4bec expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787190724.663016:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787190724.663019:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190724.663021:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190724.663022:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190724.663024:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190724.663025:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190724.663027:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190724.663029:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190724.663030:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787190724.663035:0:24259:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787190724.663038:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787190724.663040:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787190724.663041:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787190724.663042:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787190724.663044:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787190724.663045:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787190724.663046:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787190724.663047:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787190724.663048:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787190724.663067:0:24259:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787190724.663080:0:24259:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695830784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787190724.664498:0:24259:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.664548:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830784 00000100:00100000:1.0:1787190724.664556:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830784 00000100:00100000:1.0:1787190724.664603:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787190724.664624:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:24259:x1874004695830784:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787190724.664650:0:22753:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787190724.664664:0:22753:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787190724.664908:0:24259:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158868f00 going to sleep for 11 seconds 20000000:01000000:2.0:1787190724.675944:0:22753:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787190724.675968:0:22753:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787190724.676205:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787190724.676211:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787190724.676231:0:22774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676252:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676260:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676269:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676348:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 21 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676362:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 21 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190724.676377:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695830912:0@lo:104: 00000100:00100000:3.0:1787190724.676456:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787190724.676513:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676522:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 21 pid: 22753 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190724.676531:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695831040:0@lo:104: 00000100:00100000:3.0:1787190724.676554:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190724.676555:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695830912 00000100:00100000:1.0:1787190724.676567:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695830912 00000100:00100000:3.0:1787190724.676576:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f14630be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190724.676619:0:22743:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787190724.676631:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831040 00000100:00100000:1.0:1787190724.676633:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831040 00000100:00100000:1.0:1787190724.676650:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190724.676661:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695830912:12345-0@lo:104: 00010000:00010000:1.0:1787190724.676673:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.676727:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190724.676734:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695830912:12345-0@lo:104: Request processed in 75us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190724.676741:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190724.676760:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190724.676766:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f158788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695831040:12345-0@lo:104: 00010000:00010000:1.0:1787190724.676772:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.676834:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190724.676853:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190724.676858:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f158788c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695831040:12345-0@lo:104: Request processed in 93us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190724.676863:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190724.676891:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695830912:0@lo:104: 00010000:00010000:1.0:1787190724.676894:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190724.676900:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190724.676904:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695831040:0@lo:104: 00010000:00010000:1.0:1787190724.676908:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11000 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190724.676912:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.676924:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.676933:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190724.676942:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190724.676949:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787190724.676983:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.676990:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190724.677010:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.677018:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f154d11000/0xdedcc04674eb4b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b67 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190724.677042:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190724.677043:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190724.677045:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190724.677055:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190724.677059:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695831168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190724.677070:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bbc00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:2.0:1787190724.677074:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.677082:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190724.677093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1787190724.677103:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787190724.677108:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787190724.677134:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.677139:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787190724.677147:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.677153:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1667bbc00/0xdedcc04674eb4b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b75 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190724.677166:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190724.677167:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190724.677169:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190724.677275:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831168 00000100:00100000:3.0:1787190724.677280:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831168 00010000:00010000:3.0:1787190724.677320:0:22745:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 22 pid: 22753 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190724.677343:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787190724.677356:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:3653:x1874004695831168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190724.677368:0:22745:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190724.677374:0:22745:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 22 pid: 22753 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.677383:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 22 pid: 22753 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.677395:0:22745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b60 expref: 22 pid: 22753 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.677408:0:22745:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190724.677436:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:3653:x1874004695831168:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190724.677442:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190724.677740:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:24259:x1874004695830784:12345-0@lo:253:mount.lustre.0 Request processed in 13119us (14604us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190724.677940:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695831168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190724.677957:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190724.677964:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695831296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190724.677990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190724.678112:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787190724.678172:0:24259:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:24259:1874004695830784:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787190724.678250:0:24259:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787190724.678254:0:24259:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787190724.678255:0:24259:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787190724.678256:0:24259:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787190724.678257:0:24259:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787190724.678258:0:24259:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787190724.678260:0:24259:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787190724.678261:0:24259:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787190724.678263:0:24259:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787190724.678264:0:24259:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787190724.678274:0:24259:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787190724.679659:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831296 00000100:00100000:0.0:1787190724.679668:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831296 00010000:00010000:0.0:1787190724.679694:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 20 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190724.679733:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190724.679741:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166693c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:3653:x1874004695831296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787190724.679760:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190724.679766:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 20 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679778:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 20 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679793:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b6e expref: 20 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679808:0:22746:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679815:0:22746:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787190724.679830:0:22746:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015837773s 00010000:00010000:0.0:1787190724.679836:0:22746:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679843:0:22746:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679849:0:22746:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679856:0:22746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679863:0:22746:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d10000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190724.679867:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679881:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679897:0:22746:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.679906:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190724.679907:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190724.679913:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190724.679928:0:22774:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d10000/0xdedcc04674eb4c1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190724.679965:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166693c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:3653:x1874004695831296:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190724.679972:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190724.679986:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695831296:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1787190724.683790:0:24259:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787190724.688336:0:24259:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787190724.688345:0:24259:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787190724.688376:0:24259:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787190724.688417:0:24259:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787190724.688438:0:24259:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787190724.688452:0:24259:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1787190724.689091:0:24259:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190724.689235:0:24259:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1787190725.267390:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695831424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190725.267472:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190725.269280:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831424 00000100:00100000:3.0:1787190725.269308:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831424 00000100:00100000:3.0:1787190725.269366:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190725.269378:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695831424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190725.269431:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190725.269506:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695831424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190725.269513:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787190725.270064:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695831552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190725.270109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190725.270155:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831552 00000100:00100000:1.0:1787190725.270160:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831552 00000100:00100000:1.0:1787190725.270186:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190725.270192:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695831552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190725.270215:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787190725.270254:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695831552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190725.270260:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787190725.270323:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695831552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787190725.271174:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695831424:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787190725.394734:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1787190725.626932:0:24339:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787190725.627815:0:24339:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1787190725.913827:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787190725.913833:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f144dc0000 from 13 10000000:01000000:3.0:1787190725.913838:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787190725.913893:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190725.913905:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190725.913931:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190725.913956:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190725.914036:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190725.914073:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165ec8540 going to sleep for 11 seconds 00000100:00100000:0.0:1787190725.917788:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831680 00000100:00100000:0.0:1787190725.917801:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831680 00000100:00100000:0.0:1787190725.917863:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787190725.917874:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+19:22756:x1874004695831680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190725.917891:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190725.917912:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4c24 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.917940:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.917951:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 20 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.917960:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bb200, rc 0) 00000100:00100000:0.0:1787190725.918036:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:22756:x1874004695831680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (3999us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190725.918053:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787190725.918113:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190725.918130:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918140:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190725.918202:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787190725.918240:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190725.918269:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190725.918309:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831808 00000100:00100000:0.0:1787190725.918314:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831808 00000100:00100000:0.0:1787190725.918337:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787190725.918343:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:22756:x1874004695831808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787190725.918356:0:22753:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787190725.918371:0:22753:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787190725.918374:0:22753:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1787190725.918445:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:22756:x1874004695831808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190725.918452:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787190725.918481:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787190725.918535:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787190725.918690:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918758:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190725.918768:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787190725.918770:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f15e512000 from 13 10000000:01000000:0.0:1787190725.918773:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787190725.918790:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918798:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918806:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190725.918820:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190725.918844:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190725.918858:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190725.918870:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695831936 00000100:00100000:0.0:1787190725.918873:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695831936 00000100:00100000:0.0:1787190725.918894:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787190725.918899:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:22756:x1874004695831936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190725.918906:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190725.918914:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4c32 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918929:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.918946:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 21 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190725.919240:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bae00, rc 0) 00000100:00100000:0.0:1787190725.919806:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695831936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 904us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190725.919814:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787190725.924149:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695831936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190725.924180:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190725.924193:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190725.924267:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695832064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787190725.924356:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190725.924395:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1466b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190725.924480:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832064 00000100:00100000:3.0:1787190725.924488:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832064 00000100:00100000:3.0:1787190725.924531:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787190725.924617:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695832064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787190725.924643:0:22751:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787190725.924660:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787190725.924663:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1787190725.924822:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695832064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 282us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190725.924831:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787190725.925692:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695832064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787190725.925837:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787190725.925846:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190725.925863:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190726.418437:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190727.442455:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190728.471057:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190728.723387:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787190729.492329:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787190729.876999:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190729.877006:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787190729.877009:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190729.877012:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787190729.877037:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190729.877041:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787190729.877044:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787190729.877047:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787190729.877132:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695832192:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877200:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877235:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695832704:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877257:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877279:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787190729.877284:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695832320:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877325:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877343:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695832832:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877394:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695832448:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877433:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695832960:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877468:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787190729.877474:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695832576:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877494:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190729.877524:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832192 00000100:00100000:3.0:1787190729.877532:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832192 00000100:00100000:3.0:1787190729.877618:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787190729.877628:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:3653:x1874004695832192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877749:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:3653:x1874004695832192:12345-0@lo:400:kworker.0 Request processed in 122us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190729.877757:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787190729.877796:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832704 00000100:00100000:3.0:1787190729.877801:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832704 00000100:00100000:1.0:1787190729.877826:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832320 00000100:00100000:1.0:1787190729.877833:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832320 00000100:00100000:3.0:1787190729.877834:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832832 00000100:00100000:3.0:1787190729.877839:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832832 00000100:00100000:3.0:1787190729.877872:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832448 00000100:00100000:1.0:1787190729.877874:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832576 00000100:00100000:3.0:1787190729.877875:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832448 00000100:00100000:1.0:1787190729.877881:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832576 00000100:00100000:3.0:1787190729.877893:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695832960 00000100:00100000:3.0:1787190729.877897:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695832960 00000100:00100000:1.0:1787190729.877908:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787190729.877919:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695832320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.877925:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190729.877936:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695832704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190729.877972:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695832320:12345-0@lo:400:kworker.0 Request processed in 55us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190729.877980:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190729.877984:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695832704:12345-0@lo:400:kworker.0 Request processed in 49us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190729.877994:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190729.878000:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787190729.878009:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695832576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.878014:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787190729.878024:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695832832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190729.878052:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695832576:12345-0@lo:400:kworker.0 Request processed in 44us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190729.878060:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190729.878065:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695832832:12345-0@lo:400:kworker.0 Request processed in 43us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190729.878072:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787190729.878091:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787190729.878099:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695832448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190729.878105:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695832576:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.878130:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695832448:12345-0@lo:400:kworker.0 Request processed in 31us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190729.878139:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787190729.878148:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17cdf7480 x1874004695832448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190729.878156:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787190729.878167:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695832960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190729.878168:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695832448:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.878212:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695832960:12345-0@lo:400:kworker.0 Request processed in 46us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190729.878220:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787190729.878230:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17c5e9180 x1874004695832960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190729.878251:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695832960:0@lo:400:kworker.0 00000100:00080000:3.0:1787190729.878269:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787190729.878280:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787190729.878327:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695832320:0@lo:400:kworker.0 00010000:00080000:3.0:1787190729.878339:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17c5eb800 x1874004695832832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190729.878349:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695832832:0@lo:400:kworker.0 00000100:00100000:3.0:1787190729.878357:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695832192:0@lo:400:kworker.0 00010000:00080000:3.0:1787190729.878365:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17cdf6680 x1874004695832704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190729.878373:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695832704:0@lo:400:kworker.0 00000100:00100000:2.0:1787190730.389665:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787190730.389691:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695833088:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190730.389774:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190730.389835:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833088 00000100:00100000:2.0:1787190730.389844:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833088 00000100:00100000:2.0:1787190730.389903:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190730.389913:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695833088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787190730.389951:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787190730.390003:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695833088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190730.390011:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190730.390063:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695833088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190730.391247:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787190730.391265:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695833216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787190730.391357:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190730.391400:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833216 00000100:00100000:1.0:1787190730.391406:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833216 00000100:00100000:1.0:1787190730.391440:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787190730.391448:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695833216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787190730.391476:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190730.391523:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695833216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190730.391529:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787190730.391582:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695833216:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1787190730.518645:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787190731.363746:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787190731.541793:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190731.698103:0:24629:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787190732.563034:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787190732.593134:0:24682:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190732.593703:0:24682:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1787190733.350396:0:24732:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1787190733.350594:0:24732:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787190733.587393:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190734.610425:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190734.937427:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190719/real 1787190719] req@ffff99f1666cf800 x1874004695825536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190734 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.937636:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f1666cf800 x1874004695825536/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190734 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.937648:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190719/real 1787190719] req@ffff99f1666cdf80 x1874004695825664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190734 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.937661:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f1666cdf80 x1874004695825664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190734 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787190734.937683:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f158353000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190734.938603:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787190734.938610:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695825536:0@lo:8:kworker.0 00000100:00080000:2.0:1787190734.938619:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190734.941722:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787190734.941740:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695825664:0@lo:8:kworker.0 00000100:00080000:1.0:1787190734.943448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190734.943453:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190734.943456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190734.943467:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190734.943484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190734.943487:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787190734.943491:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f158353000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190734.943497:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00100000:2.0:1787190734.943569:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695833344:0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.943656:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787190734.943665:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787190734.943672:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff99f158353000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190734.943694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17d99ca80 x1874004695833856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190734.943706:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1787190734.943710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1787190734.943712:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695833728:0@lo:400:kworker.0 00000100:00080000:1.0:1787190734.943714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787190734.943716:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190734.943719:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 696 00000100:00080000:1.0:1787190734.943721:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787190734.943725:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99f143e76000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190734.943736:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17d99c000 x1874004695833984/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190734.943737:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.943756:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695834112:0@lo:400:kworker.0 00000100:00080000:1.0:1787190734.943768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190734.943771:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190734.943773:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190734.943775:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787190734.943777:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190734.943794:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695833472:0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.943807:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833728 00000100:00100000:2.0:1787190734.943814:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833728 00000100:00100000:1.0:1787190734.943818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190734.943834:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874004695834240:0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.943857:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.943864:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833472 00000100:00100000:2.0:1787190734.943867:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833472 00000100:00100000:1.0:1787190734.943874:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190734.943878:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695833600:0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.943883:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190734.943891:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695833728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.943896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190734.943919:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695834368:0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.943937:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.943939:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695833728:12345-0@lo:400:kworker.0 Request processed in 49us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190734.943946:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190734.943961:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787190734.943964:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833344 00000100:00100000:2.0:1787190734.943966:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695833472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.943967:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833344 00000100:00100000:1.0:1787190734.943995:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787190734.943996:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695833472:12345-0@lo:400:kworker.0 Request processed in 30us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.944000:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:3654:x1874004695833344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.944002:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787190734.944027:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:3654:x1874004695833344:12345-0@lo:400:kworker.0 Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.944033:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787190734.944065:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834112 00000100:00100000:1.0:1787190734.944068:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834112 00000100:00100000:2.0:1787190734.945182:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834240 00000100:00100000:2.0:1787190734.945190:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834240 00000100:00100000:1.0:1787190734.945193:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833600 00000100:00100000:1.0:1787190734.945196:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833600 00000100:00100000:1.0:1787190734.945211:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834368 00000100:00100000:1.0:1787190734.945214:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834368 00000100:00100000:2.0:1787190734.945227:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190734.945234:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695834112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.945829:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695834112:12345-0@lo:400:kworker.0 Request processed in 594us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.946201:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190734.946212:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695833600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.946251:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695833600:12345-0@lo:400:kworker.0 Request processed in 42us (2352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.946257:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190734.946278:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190734.946299:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874004695834240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.946329:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874004695834240:12345-0@lo:400:kworker.0 Request processed in 45us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.946335:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787190734.946346:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787190734.946353:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695834368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190734.946388:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695834368:12345-0@lo:400:kworker.0 Request processed in 36us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.946394:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1787190734.947364:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17cdf6680 x1874004695834112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190734.947380:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695834112:0@lo:400:kworker.0 00000100:00100000:0.0:1787190734.947391:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695833728:0@lo:400:kworker.0 00000100:00100000:0.0:1787190734.947399:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695833344:0@lo:400:kworker.0 00000100:00100000:0.0:1787190734.947432:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695833856:0@lo:8:kworker.0 00000100:00100000:0.0:1787190734.947496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190734.947705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695833984:0@lo:8:kworker.0 00000100:00100000:0.0:1787190734.947733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190734.947764:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833856 00000100:00100000:0.0:1787190734.947770:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833856 00000100:00100000:0.0:1787190734.947798:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695833984 00000100:00100000:0.0:1787190734.947800:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695833984 00000100:00100000:0.0:1787190734.947811:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190734.947816:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874004695833856:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787190734.947851:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 712 last 0 00000020:00000080:0.0:1787190734.947876:0:24264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4c40 00002000:00100000:0.0:1787190734.947891:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff99f170339000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1787190734.947895:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1787190734.947898:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190734.948065:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1787190734.948092:0:24264:0:(import.c:65:import_set_state_nolock()) ffff99f17033c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190734.948134:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874004695833856:12345-0@lo:8:kworker.0 Request processed in 316us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190734.948140:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787190734.948155:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787190734.948159:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874004695833984:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787190734.948170:0:24264:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787190734.949360:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787190734.949405:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787190734.949411:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787190734.949673:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17d99ed80 x1874004695833600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.949691:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695833600:0@lo:400:kworker.0 00010000:00080000:2.0:1787190734.949713:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17cdf5500 x1874004695834368/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.949721:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695834368:0@lo:400:kworker.0 00000100:00100000:2.0:1787190734.949732:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695833472:0@lo:400:kworker.0 00010000:00080000:2.0:1787190734.949743:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17cdf4700 x1874004695834240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.949750:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874004695834240:0@lo:400:kworker.0 00010000:00080000:2.0:1787190734.950419:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f17d99ca80 x1874004695833856/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.950429:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787190734.950506:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1787190734.950525:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787190734.950531:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787190734.950535:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f158353000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787190734.950550:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787190734.950556:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695833856:0@lo:8:kworker.0 00000004:00080000:2.0:1787190734.950930:0:23500:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1787190734.950934:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695834496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190734.950951:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834624:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1787190734.955682:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190734.955772:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834496 00000100:00100000:1.0:1787190734.955782:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834496 00000100:00100000:1.0:1787190734.955833:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190734.955844:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874004695834496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787190734.955875:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787190734.955925:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1874004695834496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190734.955932:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787190734.955953:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787190734.955983:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666ce300 x1874004695834496/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190750 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190734.956003:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695834496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190734.960122:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.960170:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e43480 going to sleep for 11 seconds 00000004:00080000:2.0:1787190734.960401:0:23499:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787190734.960566:0:23499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 712125277612ns, next at 0ns, rc = 0 00080000:00080000:2.0:1787190734.960573:0:23499:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787190734.966387:0:24263:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787190734.966401:0:24263:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787190734.966544:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834624 00000100:00100000:2.0:1787190734.966553:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834624 00000100:00100000:2.0:1787190734.966668:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190734.966680:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23500:x1874004695834624:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787190734.968400:0:23491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:2.0:1787190734.970620:0:24811:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1787190734.970628:0:24811:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787190734.970718:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23500:x1874004695834624:12345-0@lo:7:osp-pre-0-1.0 Request processed in 4037us (10597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190734.970741:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787190734.970797:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666ced80 x1874004695834624/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787190750 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.970812:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834624:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1787190734.970825:0:23500:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787190734.970864:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834752:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787190734.970897:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.970918:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e43480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190734.970935:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834752 00000100:00100000:2.0:1787190734.970949:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834752 00000100:00100000:2.0:1787190734.970987:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190734.971010:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23500:x1874004695834752:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787190734.971036:0:24263:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787190734.971066:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23500:x1874004695834752:12345-0@lo:5:osp-pre-0-1.0 Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190734.971073:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787190734.971099:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666ced80 x1874004695834752/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190750 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.971108:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834752:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1787190734.971116:0:23500:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1787190734.971139:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834880:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1787190734.971159:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190734.971172:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e43480 going to sleep for 11 seconds 00000100:00100000:2.0:1787190734.971182:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695834880 00000100:00100000:2.0:1787190734.971185:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695834880 00000100:00100000:2.0:1787190734.971205:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190734.971210:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23500:x1874004695834880:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1787190734.971232:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1787190734.981393:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874004695833984:12345-0@lo:8:kworker.0 Request processed in 33227us (33653us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787190734.981412:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787190734.981687:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190734.981695:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787190734.981699:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695833984:0@lo:8:kworker.0 00000001:00080000:0.0:1787190734.993856:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1787190734.993871:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1787190734.994255:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23500:x1874004695834880:12345-0@lo:5:osp-pre-0-1.0 Request processed in 23039us (23089us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787190734.994267:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787190734.994725:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666ced80 x1874004695834880/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787190750 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190734.994738:0:23500:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1787190734.994745:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23500:1874004695834880:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1787190734.994762:0:23500:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1787190734.994815:0:23500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1874004695835008:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1787190734.994851:0:23500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190734.994919:0:23500:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c396a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787190734.994974:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835008 00000100:00100000:3.0:1787190734.994981:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835008 00000100:00100000:3.0:1787190734.995062:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190734.995072:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1874004695835008:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787190734.995131:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23500:x1874004695835008:12345-0@lo:900:osp-pre-0-1.0 Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190734.995137:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787190734.995191:0:23500:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1483fea00 x1874004695835008/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787190750 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190734.995202:0:23500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23500:1874004695835008:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1787190735.507265:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190735.507475:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787190735.507504:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695835264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190735.507598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190735.507657:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835264 00000100:00100000:0.0:1787190735.507665:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835264 00000100:00100000:0.0:1787190735.507714:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787190735.507723:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695835264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1787190735.507755:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1787190735.507802:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695835264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190735.507809:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787190735.507858:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695835264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787190735.512115:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695835136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1787190735.512197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190735.512550:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835136 00000100:00100000:1.0:1787190735.512559:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835136 00000100:00100000:1.0:1787190735.512632:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787190735.512643:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695835136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190735.512678:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787190735.512735:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695835136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190735.512756:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787190735.512786:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695835136:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1787190735.635416:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190736.658616:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190737.683474:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190738.707422:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787190738.963027:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1787190739.190857:0:25078:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787190739.190862:0:25078:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787190739.190863:0:25078:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1787190739.191182:0:25078:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99f1587ec800 00000020:01000004:1.0:1787190739.191203:0:25078:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787190739.191219:0:25078:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1787190739.191236:0:25078:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99f17c1319b8) 00000020:00000080:1.0:1787190739.191256:0:25078:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1787190739.301348:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1787190739.302207:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1787190739.303275:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1787190739.303925:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1787190739.304178:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1787190739.304555:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1787190739.304939:0:25078:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1787190739.308956:0:25078:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1787190739.309169:0:25078:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787190739.309185:0:25078:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787190739.309197:0:25078:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdedcc04674eb4c4e 00000020:01000004:1.0:1787190739.309203:0:25078:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1787190739.309222:0:25078:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787190739.309225:0:25078:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787190739.309229:0:25078:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787190739.309252:0:25078:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1787190739.309255:0:25078:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787190739.316823:0:25078:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787190739.316865:0:25078:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.122@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787190739.316870:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787190739.316872:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190739.316873:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190739.316874:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190739.316876:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190739.316877:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190739.316878:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190739.316880:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190739.316882:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787190739.316886:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787190739.316888:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787190739.316889:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190739.316890:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190739.316891:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190739.316893:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190739.316894:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190739.316899:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190739.316900:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190739.316901:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787190739.316926:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787190739.316943:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787190739.317055:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190739.317098:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15f600 going to sleep for 11 seconds 00000100:00100000:3.0:1787190739.317112:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835392 00000100:00100000:3.0:1787190739.317119:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835392 00000100:00100000:3.0:1787190739.317172:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787190739.317181:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:25078:x1874004695835392:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787190739.317207:0:22751:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787190739.317210:0:22751:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1787190739.317213:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787190739.317916:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:25078:x1874004695835392:12345-0@lo:253:mount.lustre.0 Request processed in 732us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.317927:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787190739.317947:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787190739.317958:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787190739.317960:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787190739.317962:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787190739.317963:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787190739.317964:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787190739.317965:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787190739.317966:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787190739.317967:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787190739.317969:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787190739.317970:0:25078:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787190739.318054:0:25078:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99f1587ec800 from lustre-OST0001 10000000:01000000:0.0:1787190739.318077:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787190739.318079:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787190739.318087:0:25078:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99f1794b99b8 local copy 00010000:00010000:0.0:1787190739.318095:0:25078:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190739.318159:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835520:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.318181:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190739.318205:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787190739.318219:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835520 00000100:00100000:1.0:1787190739.318225:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835520 00000100:00100000:1.0:1787190739.318259:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787190739.318266:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:25078:x1874004695835520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.318389:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:25078:x1874004695835520:12345-0@lo:501:mount.lustre.0 Request processed in 122us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787190739.318397:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787190739.318435:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835520:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787190739.318447:0:25078:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787190739.318465:0:25078:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787190739.318470:0:25078:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.318494:0:25078:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b5400/0xdedcc04674eb4968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb496f expref: -99 pid: 22738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190739.318522:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99f1587ec800 10000000:01000000:3.0:1787190739.318527:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787190739.318532:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787190739.318534:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787190739.318538:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787190739.318541:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787190739.318560:0:25078:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.318580:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.318590:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190739.318602:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787190739.318841:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.318893:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1412549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.318926:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835648 00000100:00100000:2.0:1787190739.318930:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835648 00000100:00100000:2.0:1787190739.318956:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787190739.318961:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:25078:x1874004695835648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190739.318968:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190739.318979:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039f600/0xdedcc04674eb4c5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4c55 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.318999:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039f600/0xdedcc04674eb4c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4c55 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.319009:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039f600/0xdedcc04674eb4c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c55 expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.319017:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039f600, rc 0) 00000100:00100000:2.0:1787190739.319089:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695835648:12345-0@lo:101:mount.lustre.0 Request processed in 128us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.319094:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787190739.319158:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190739.319167:0:25078:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c5c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.319174:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4c5c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190739.320176:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1787190739.320660:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787190739.322186:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1787190739.322228:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1787190739.322244:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1787190739.322258:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1787190739.322272:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1787190739.322433:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1787190739.322448:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1787190739.322459:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1787190739.322471:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1787190739.322508:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1787190739.322515:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1787190739.322614:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190739.322678:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.322759:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f166656c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.322806:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835776 00000100:00100000:0.0:1787190739.322820:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835776 00000100:00100000:0.0:1787190739.322894:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787190739.322905:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695835776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.323105:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695835776:12345-0@lo:501:mount.lustre.0 Request processed in 202us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.323114:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787190739.323225:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835776:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190739.323252:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835904:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190739.323282:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.323402:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f141254540 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.323473:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695835904 00000100:00100000:0.0:1787190739.323486:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695835904 00000100:00100000:0.0:1787190739.323508:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787190739.323514:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695835904:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190739.324179:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695835904:12345-0@lo:503:mount.lustre.0 Request processed in 664us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.324185:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787190739.324242:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695835904:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787190739.324657:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787190739.324722:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190739.324761:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.324782:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1412549c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.324883:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836032 00000100:00100000:2.0:1787190739.324887:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836032 00000100:00100000:2.0:1787190739.324915:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787190739.324924:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695836032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190739.325508:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695836032:12345-0@lo:502:mount.lustre.0 Request processed in 583us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.325516:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787190739.325599:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190739.325799:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1787190739.325826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1787190739.325841:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1787190739.325857:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1787190739.325871:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1787190739.325884:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1787190739.325895:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1787190739.325908:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1787190739.325923:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1787190739.325943:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190739.325970:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.326105:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1412549c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.326277:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836160 00000100:00100000:0.0:1787190739.326284:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836160 00000100:00100000:0.0:1787190739.326451:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787190739.326460:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695836160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190739.326577:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695836160:12345-0@lo:502:mount.lustre.0 Request processed in 119us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.326584:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787190739.326650:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190739.326697:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1787190739.326706:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1787190739.327623:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787190739.327632:0:25082:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1787190739.327639:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.327641:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787190739.327647:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787190739.327661:0:25082:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99f1486699b8) 00000020:00000080:3.0:1787190739.327684:0:25082:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787190739.327690:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787190739.327774:0:25082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f1587ec800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787190739.327783:0:25082:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787190739.327789:0:25082:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdedcc04674eb4c6a 00010000:00010000:3.0:1787190739.327941:0:25082:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1787190739.328664:0:25082:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1787190739.330246:0:25082:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1787190739.332194:0:25082:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787190739.332205:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.332210:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.332212:0:25082:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787190739.332216:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.332220:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.332221:0:25082:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787190739.332224:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787190739.332226:0:25082:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787190739.332228:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.332230:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.332231:0:25082:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787190739.332234:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.332236:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.332237:0:25082:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787190739.332239:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787190739.332261:0:25082:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.332263:0:25082:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.332264:0:25082:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787190739.332267:0:25082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1787190739.338909:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787190739.338957:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787190739.338982:0:25078:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c5c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.339005:0:25078:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d11600/0xdedcc04674eb4c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c5c expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190739.339014:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f1587ec800 from 1 10000000:01000000:1.0:1787190739.339017:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190739.339054:0:25078:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.339062:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.339073:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190739.339098:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836288:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787190739.339170:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.339210:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.339895:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836288 00000100:00100000:2.0:1787190739.339903:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836288 00000100:00100000:2.0:1787190739.340053:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787190739.340063:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695836288:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787190739.340077:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190739.340090:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4c71 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.340115:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.340126:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.340154:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17039f000, rc 0) 00000100:00100000:2.0:1787190739.340273:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836288:12345-0@lo:101:mount.lustre.0 Request processed in 211us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.340280:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787190739.340460:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190739.340486:0:25078:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.340496:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787190739.341703:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1787190739.341958:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787190739.342132:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1787190739.342158:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1787190739.342172:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1787190739.342197:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1787190739.342208:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1787190739.342219:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1787190739.342230:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1787190739.342240:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1787190739.342253:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1787190739.342265:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1787190739.342278:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1787190739.342536:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1787190739.342545:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1787190739.342619:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190739.342678:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.342769:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.342814:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836416 00000100:00100000:0.0:1787190739.342820:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836416 00000100:00100000:0.0:1787190739.342898:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787190739.342908:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.343037:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836416:12345-0@lo:501:mount.lustre.0 Request processed in 130us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.343054:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787190739.343122:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787190739.343151:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787190739.343188:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.343499:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787190739.343579:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836544 00000100:00100000:1.0:1787190739.343585:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836544 00000100:00100000:1.0:1787190739.343611:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787190739.343619:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836544:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787190739.343717:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836544:12345-0@lo:503:mount.lustre.0 Request processed in 98us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.343732:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787190739.343807:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787190739.344174:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787190739.344233:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190739.344274:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.344337:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cb480 going to sleep for 11 seconds 00000100:00100000:1.0:1787190739.344453:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836672 00000100:00100000:1.0:1787190739.344459:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836672 00000100:00100000:1.0:1787190739.344491:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787190739.344498:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836672:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190739.344584:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836672:12345-0@lo:502:mount.lustre.0 Request processed in 85us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.344590:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787190739.344662:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190739.344826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1787190739.344850:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1787190739.344866:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1787190739.344879:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1787190739.344905:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1787190739.344919:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1787190739.344932:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1787190739.344944:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1787190739.344959:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1787190739.344971:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1787190739.345044:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1787190739.345063:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787190739.345094:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.345147:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cb480 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.345261:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836800 00000100:00100000:0.0:1787190739.345266:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836800 00000100:00100000:1.0:1787190739.345326:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787190739.345335:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787190739.345402:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836800:12345-0@lo:502:mount.lustre.0 Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.345407:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787190739.345520:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787190739.345557:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1787190739.345565:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1787190739.346137:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.346149:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346151:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787190739.346158:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f1587ec800 00000020:00000080:3.0:1787190739.346161:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190739.346169:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.346171:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346173:0:25086:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787190739.346175:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.346178:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346180:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787190739.346183:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99f1587ec800 00000020:00000080:3.0:1787190739.346185:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190739.346245:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.346249:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346250:0:25086:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787190739.346253:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.346255:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346256:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190739.346266:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f1587ec800 00000020:00000080:3.0:1787190739.346269:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190739.346314:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.346318:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346319:0:25086:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787190739.346322:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787190739.346324:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346326:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1787190739.346329:0:25086:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99f1587ec800 00000020:00000080:3.0:1787190739.346331:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787190739.346367:0:25086:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787190739.346370:0:25086:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787190739.346372:0:25086:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1787190739.346374:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1787190739.346409:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1787190739.346430:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190739.346445:0:25078:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.346457:0:25078:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190739.346537:0:25078:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787190739.346541:0:25078:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99f1587ec800 10000000:01000000:3.0:1787190739.346544:0:25078:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99f1587ec800 10000000:01000000:3.0:1787190739.346548:0:25078:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787190739.346554:0:25078:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99f1587ec800 from 1 10000000:01000000:3.0:1787190739.346556:0:25078:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787190739.346581:0:25078:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.346589:0:25078:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.346606:0:25078:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190739.346622:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787190739.346661:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.346686:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787190739.346949:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695836928 00000100:00100000:1.0:1787190739.346954:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695836928 00000100:00100000:1.0:1787190739.346977:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787190739.346982:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:25078:x1874004695836928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787190739.347048:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190739.347058:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b4c00/0xdedcc04674eb4c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4c7f expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.347077:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b4c00/0xdedcc04674eb4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4c7f expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.347087:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b4c00/0xdedcc04674eb4c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c7f expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190739.347108:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b4c00, rc 0) 00000100:00100000:1.0:1787190739.347144:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695836928:12345-0@lo:101:mount.lustre.0 Request processed in 161us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.347150:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787190739.347237:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695836928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787190739.347250:0:25078:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c86 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.347259:0:25078:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4c86 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190739.368134:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1787190739.370820:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190739.372698:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1787190739.372748:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1787190739.372763:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1787190739.372776:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1787190739.372789:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1787190739.372802:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1787190739.372814:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1787190739.372826:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1787190739.372841:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1787190739.372856:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1787190739.372870:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1787190739.372881:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1787190739.372894:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1787190739.372907:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1787190739.372921:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1787190739.372934:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1787190739.372948:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1787190739.372962:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1787190739.372977:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1787190739.373351:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1787190739.373374:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1787190739.373388:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1787190739.373399:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1787190739.373415:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1787190739.373430:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1787190739.373443:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1787190739.373472:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1787190739.373500:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1787190739.373513:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1787190739.373527:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1787190739.373541:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1787190739.373555:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1787190739.373567:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1787190739.373578:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1787190739.373591:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1787190739.373605:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1787190739.373619:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1787190739.373633:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1787190739.373646:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1787190739.373661:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1787190739.373673:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1787190739.373686:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1787190739.373699:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1787190739.373713:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1787190739.373727:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1787190739.373748:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1787190739.373781:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1787190739.373793:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1787190739.373944:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1787190739.373963:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1787190739.373982:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1787190739.374946:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1787190739.375201:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.375270:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190739.375334:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f145462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.375611:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837056 00000100:00100000:2.0:1787190739.375619:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837056 00000100:00100000:2.0:1787190739.375665:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787190739.375675:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787190739.375794:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837056:12345-0@lo:501:mount.lustre.0 Request processed in 120us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.375803:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787190739.375906:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787190739.375940:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787190739.376061:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190739.376091:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f145462540 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.377166:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837184 00000100:00100000:2.0:1787190739.377176:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837184 00000100:00100000:2.0:1787190739.377211:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787190739.377219:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837184:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787190739.377343:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837184:12345-0@lo:503:mount.lustre.0 Request processed in 125us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.377351:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787190739.377401:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837184:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787190739.377829:0:25078:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787190739.377903:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190739.377943:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.377965:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.380119:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837312 00000100:00100000:0.0:1787190739.380132:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837312 00000100:00100000:0.0:1787190739.380191:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787190739.380202:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190739.380388:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837312:12345-0@lo:502:mount.lustre.0 Request processed in 188us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.380396:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787190739.382466:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190739.383110:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1787190739.383144:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1787190739.383160:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1787190739.383174:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1787190739.383189:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1787190739.383202:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1787190739.383215:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1787190739.383249:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1787190739.383265:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1787190739.383277:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1787190739.383428:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1787190739.383446:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1787190739.383458:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1787190739.383470:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1787190739.383494:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1787190739.383506:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1787190739.383518:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1787190739.383530:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1787190739.383541:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1787190739.383553:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1787190739.383565:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1787190739.383578:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1787190739.383591:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1787190739.383620:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1787190739.383634:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1787190739.383649:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1787190739.383663:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1787190739.383675:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1787190739.383688:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1787190739.383701:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1787190739.383714:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1787190739.383727:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1787190739.383750:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1787190739.383764:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1787190739.383776:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1787190739.383789:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1787190739.383802:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1787190739.383815:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1787190739.383829:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1787190739.383856:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1787190739.383871:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1787190739.383884:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1787190739.383896:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1787190739.383909:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1787190739.383922:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1787190739.383936:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1787190739.383948:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1787190739.383960:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1787190739.384082:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190739.384160:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.384262:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.388099:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837440 00000100:00100000:0.0:1787190739.388115:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837440 00000100:00100000:0.0:1787190739.388179:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787190739.388189:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190739.388395:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837440:12345-0@lo:502:mount.lustre.0 Request processed in 207us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.388403:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787190739.388692:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190739.388911:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1787190739.388940:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1787190739.388976:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787190739.389095:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.389170:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d840 going to sleep for 11 seconds 00000100:00100000:0.0:1787190739.391967:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837568 00000100:00100000:0.0:1787190739.391984:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837568 00000100:00100000:0.0:1787190739.392126:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787190739.392138:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787190739.392338:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695837568:12345-0@lo:502:mount.lustre.0 Request processed in 202us (3242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190739.392346:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787190739.392697:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695837568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787190739.392780:0:25078:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1787190739.392794:0:25078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1787190739.393847:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787190739.393863:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99f1667a8000) 00000020:00000080:0.0:1787190739.393890:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1787190739.394075:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f1587ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787190739.394085:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f1587ec800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787190739.394088:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1587ec800 3 00010000:00080000:0.0:1787190739.394126:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f17d9c1000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:0.0:1787190739.394270:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1787190739.399994:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787190739.400055:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190739.400069:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdedcc04674eb4c94 00000100:00080000:2.0:1787190739.400081:0:25092:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190739.400088:0:25092:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99f17d9c1000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190739.400124:0:25092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cd880 x1874004695837696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787190739.400190:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695837696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190739.400272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.400386:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837696 00000100:00100000:1.0:1787190739.400394:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837696 00000100:00100000:1.0:1787190739.400436:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787190739.400445:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3650:x1874004695837696:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787190739.400469:0:24032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1787190739.400526:0:24032:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdedcc04674eb4c9b 00000004:00100000:1.0:1787190739.400541:0:24032:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787190739.400573:0:24032:0:(import.c:65:import_set_state_nolock()) ffff99f148694800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787190739.400649:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787190739.400934:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1874004695837696:12345-0@lo:38:llog_process_th.0 Request processed in 488us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.400942:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787190739.401003:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190739.401007:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190739.401010:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190739.401013:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787190739.401043:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787190739.401047:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787190739.401049:0:36:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787190739.401053:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 712 00000100:00080000:1.0:1787190739.401063:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787190739.401067:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99f143e76000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:1.0:1787190739.401082:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f15ffab480 x1874004695838336/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787190739.401137:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401172:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401195:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190739.401201:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695837824:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401239:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874004695838464:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401280:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874004695837952:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401324:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401342:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695838592:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401361:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401375:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787190739.401380:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695838080:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401401:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401417:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874004695838720:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401436:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190739.401468:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838208 00000100:00100000:1.0:1787190739.401485:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838208 00000100:00100000:1.0:1787190739.401528:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190739.401536:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695838208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401575:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695838208:12345-0@lo:400:kworker.0 Request processed in 41us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401588:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787190739.401606:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837824 00000100:00100000:1.0:1787190739.401610:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837824 00000100:00100000:1.0:1787190739.401632:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838080 00000100:00100000:1.0:1787190739.401635:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838080 00000100:00100000:1.0:1787190739.401647:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190739.401653:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695837824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401684:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695837824:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401690:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190739.401701:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190739.401707:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695838080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401737:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695838080:12345-0@lo:400:kworker.0 Request processed in 31us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401743:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190739.401759:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838464 00000100:00100000:1.0:1787190739.401762:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838464 00000100:00100000:1.0:1787190739.401777:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695837952 00000100:00100000:1.0:1787190739.401779:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695837952 00000100:00100000:1.0:1787190739.401787:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838592 00000100:00100000:1.0:1787190739.401790:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838592 00000100:00100000:1.0:1787190739.401802:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838720 00000100:00100000:1.0:1787190739.401804:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838720 00000100:00100000:1.0:1787190739.401817:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787190739.401823:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874004695838464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401852:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1874004695838464:12345-0@lo:400:kworker.0 Request processed in 29us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401858:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787190739.401880:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787190739.401886:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874004695837952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401926:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1874004695837952:12345-0@lo:400:kworker.0 Request processed in 40us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401933:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787190739.401945:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190739.401951:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695838592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.401975:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695838592:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.401980:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787190739.401991:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190739.401997:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874004695838720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.402020:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1874004695838720:12345-0@lo:400:kworker.0 Request processed in 24us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.402026:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1787190739.402046:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1787190739.402050:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190739.402053:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787190739.402086:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695837824:0@lo:400:kworker.0 00010000:00080000:1.0:1787190739.402100:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f15e4e2a00 x1874004695838464/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.402109:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3651:1874004695838464:0@lo:400:kworker.0 00010000:00080000:1.0:1787190739.402119:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f15ffa8a80 x1874004695838208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787190755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.402127:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695838208:0@lo:400:kworker.0 00000100:00100000:1.0:1787190739.402168:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695838080:0@lo:400:kworker.0 00010000:00080000:1.0:1787190739.402178:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f15e4e2300 x1874004695838720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.402186:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3653:1874004695838720:0@lo:400:kworker.0 00010000:00080000:1.0:1787190739.402195:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f15ffab100 x1874004695837952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.402202:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3653:1874004695837952:0@lo:400:kworker.0 00010000:00080000:1.0:1787190739.402211:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f15e4e3480 x1874004695838592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190755 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.402218:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695838592:0@lo:400:kworker.0 00000020:01000004:2.0:1787190739.404199:0:25092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787190739.404216:0:25092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff99f1667ccd28) 00000020:00000080:2.0:1787190739.404245:0:25092:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1787190739.404345:0:25092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99f1587ec800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787190739.404348:0:25092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99f1587ec800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787190739.404351:0:25092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99f1587ec800 3 00010000:00080000:2.0:1787190739.404384:0:25092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99f170117800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.122@tcp at head 00010000:00010000:2.0:1787190739.404559:0:25092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1787190739.404726:0:25092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1787190739.404753:0:25092:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787190739.404761:0:25092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdedcc04674eb4ca9 00000100:00080000:2.0:1787190739.404770:0:25092:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787190739.404774:0:25092:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff99f170117800 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190739.404806:0:25092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cc700 x1874004695838848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190739.404821:0:25092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1787190739.404851:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190739.404856:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787190739.404859:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190739.404862:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1787190739.410265:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666cd880 x1874004695837696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190739.410283:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787190739.410355:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1787190739.410365:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787190739.410371:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787190739.410374:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17d9c1000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787190739.410383:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3650:1874004695837696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190739.410414:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695838336:0@lo:8:kworker.0 00000100:00100000:0.0:1787190739.410486:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190739.411232:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874004695838848:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787190739.411271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1787190739.414756:0:25092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:1.0:1787190739.414982:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838848 00000100:00100000:1.0:1787190739.414991:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838848 00000100:00100000:1.0:1787190739.415032:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787190739.415041:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1874004695838848:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787190739.415075:0:22760:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 716 last 0 00000020:00000080:1.0:1787190739.415110:0:22760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdedcc04674eb4cb0 00000004:00100000:1.0:1787190739.415127:0:22760:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787190739.415160:0:22760:0:(import.c:65:import_set_state_nolock()) ffff99f148695000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190739.415245:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1874004695838848:12345-0@lo:38:llog_process_th.0 Request processed in 205us (3973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190739.415252:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787190739.415323:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99f1666cc700 x1874004695838848/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787190749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190739.415347:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787190739.415357:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1787190739.415365:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787190739.415369:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1787190739.415372:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f170117800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787190739.415378:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3650:1874004695838848:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787190739.415615:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838336 00000100:00100000:2.0:1787190739.415621:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838336 00000020:01000000:2.0:1787190739.415636:0:25078:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1787190739.415671:0:25078:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787190739.415692:0:25078:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c86 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.415703:0:25078:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f154d11200/0xdedcc04674eb4c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4c86 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787190739.415753:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787190739.415756:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190739.415757:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190739.415758:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190739.415759:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190739.415760:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190739.415761:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190739.415763:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190739.415764:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190739.415768:0:25078:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787190739.415770:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787190739.415772:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190739.415773:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190739.415774:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190739.415775:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190739.415776:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190739.415777:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190739.415778:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190739.415779:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787190739.415799:0:25078:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787190739.415815:0:25078:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695838976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787190739.415859:0:25078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.415926:0:25078:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17039d180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.415978:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190739.415985:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874004695838336:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787190739.416039:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3650:x1874004695838336:12345-0@lo:8:kworker.0 Request processed in 53us (5562us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787190739.416045:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190739.416074:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787190739.416078:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787190739.416082:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787190739.416085:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695838336:0@lo:8:kworker.0 00000100:00100000:1.0:1787190739.420151:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695838976 00000100:00100000:1.0:1787190739.420165:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695838976 00000100:00100000:1.0:1787190739.420265:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787190739.420278:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:25078:x1874004695838976:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787190739.420354:0:22751:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787190739.420367:0:22751:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787190739.433893:0:22751:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787190739.433915:0:22751:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787190739.434550:0:22774:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787190739.434557:0:22774:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787190739.434578:0:22774:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434598:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434605:0:22774:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434611:0:22774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434660:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434686:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190739.434702:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695839104:0@lo:104: 00000100:00100000:3.0:1787190739.434766:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787190739.434821:0:22774:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.434829:0:22774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 24 pid: 22752 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190739.434837:0:22774:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5e9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695839232:0@lo:104: 00000100:00100000:3.0:1787190739.434858:0:22774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.434881:0:22774:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703cbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787190739.434948:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839104 00000100:00100000:2.0:1787190739.434959:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839104 00000100:00100000:2.0:1787190739.434999:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839232 00000100:00100000:2.0:1787190739.435002:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839232 00000100:00100000:2.0:1787190739.435017:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190739.435028:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695839104:12345-0@lo:104: 00010000:00010000:2.0:1787190739.435041:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.435123:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787190739.435130:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:22774:x1874004695839104:12345-0@lo:104: Request processed in 104us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.435137:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190739.435153:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787190739.435160:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695839232:12345-0@lo:104: 00010000:00010000:0.0:1787190739.435166:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190739.435171:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435175:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435186:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bbe00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190739.435191:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435207:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190739.435214:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190739.435220:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190739.435248:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435254:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190739.435273:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435279:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c39 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435325:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190739.435328:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435333:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d10000 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190739.435336:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435342:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190739.435348:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190739.435358:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787190739.435372:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435378:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190739.435384:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435391:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f154d10000/0xdedcc04674eb4c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c2b expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.435404:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190739.435405:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190739.435610:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695839104:0@lo:104: 00000100:00100000:3.0:1787190739.435619:0:22774:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5e9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22774:1874004695839232:0@lo:104: 00010000:00010000:3.0:1787190739.435637:0:22774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190739.435911:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787190739.435919:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:22774:x1874004695839232:12345-0@lo:104: Request processed in 759us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190739.435933:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787190739.435960:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695839488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787190739.435995:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190739.436037:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190739.436043:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695839360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190739.436061:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839488 00000100:00100000:2.0:1787190739.436068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190739.436069:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839488 00010000:00010000:3.0:1787190739.436097:0:22745:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 25 pid: 22752 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190739.436109:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839360 00000100:00100000:2.0:1787190739.436114:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839360 00000100:00100000:3.0:1787190739.436125:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1787190739.436132:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 26 pid: 22753 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190739.436137:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+26:3652:x1874004695839488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190739.436154:0:22745:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787190739.436158:0:22746:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787190739.436168:0:22746:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787190739.436169:0:22745:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 26 pid: 22752 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436181:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 26 pid: 22752 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436196:0:22745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bb200/0xdedcc04674eb4c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4c24 expref: 26 pid: 22752 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436209:0:22745:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190739.436242:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+25:3652:x1874004695839488:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190739.436249:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787190739.436262:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190739.436267:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3652:x1874004695839360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190739.436274:0:22745:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190739.436278:0:22745:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436307:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436317:0:22745:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bae00/0xdedcc04674eb4c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4c32 expref: 24 pid: 22753 timeout: 816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436328:0:22745:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436335:0:22745:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787190739.436355:0:22745:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015837773s 00010000:00010000:3.0:1787190739.436360:0:22745:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436366:0:22745:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436372:0:22745:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436377:0:22745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436383:0:22745:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190739.436387:0:22745:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436394:0:22745:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436408:0:22745:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436429:0:22745:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190739.436453:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:3652:x1874004695839360:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190739.436459:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190739.436506:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695839360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787190739.436515:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695839488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190739.436543:0:22774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436551:0:22774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190739.436558:0:22774:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d11400/0xdedcc04674eb4cb7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190739.437724:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190739.437836:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:25078:x1874004695838976:12345-0@lo:253:mount.lustre.0 Request processed in 17559us (21973us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190739.437847:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787190739.438198:0:25078:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:edc48c39-e017-41df-adf6-48a4a7c3ab24:25078:1874004695838976:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787190739.438213:0:25078:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787190739.438216:0:25078:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787190739.438217:0:25078:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787190739.438219:0:25078:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787190739.438220:0:25078:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787190739.438221:0:25078:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787190739.438222:0:25078:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787190739.438224:0:25078:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787190739.438225:0:25078:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787190739.438227:0:25078:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787190739.438240:0:25078:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1787190739.441766:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1787190739.441878:0:25078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1787190739.445683:0:25078:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787190739.445694:0:25078:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787190739.445730:0:25078:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787190739.445778:0:25078:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787190739.445795:0:25078:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1787190739.445823:0:25078:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1787190739.446850:0:25078:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190739.451344:0:25078:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1787190739.731582:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190740.118248:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787190740.118274:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695839616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190740.118358:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.118411:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839616 00000100:00100000:2.0:1787190740.118439:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839616 00000100:00100000:2.0:1787190740.118499:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190740.118509:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695839616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787190740.118538:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787190740.118595:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695839616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.118603:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787190740.118645:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1666cc700 x1874004695839616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.118664:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695839616:0@lo:13:osp-pre-0-1.0 00000020:00000004:2.0:1787190740.384717:0:25147:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1787190740.384945:0:25147:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1787190740.434367:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190720/real 1787190720] req@ffff99f17d99d180 x1874004695827328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.434397:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17d99d180 x1874004695827328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.434407:0:3650:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787190720/real 1787190720] req@ffff99f17d99ea00 x1874004695827200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190740 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.434429:0:3650:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99f17d99ea00 x1874004695827200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787190740 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190740.434473:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190740.434497:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190740.434501:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695827328:0@lo:8:kworker.0 00000100:00080000:3.0:1787190740.434507:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787190740.434511:0:3650:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787190740.434514:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695827200:0@lo:8:kworker.0 00000100:00080000:2.0:1787190740.434716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190740.434720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787190740.434723:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190740.434728:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787190740.434733:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787190740.434740:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99f15ffbd000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190740.434759:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666ce300 x1874004695840000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190740.434769:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190740.434772:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787190740.434773:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190740.434776:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 697 00000100:00080000:2.0:1787190740.434779:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787190740.434782:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99f17c31d000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190740.434799:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f1666cca80 x1874004695840128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787190740.434819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787190740.434822:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787190740.434823:0:8:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787190740.434827:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff99f143e76000 using connection 192.168.202.122@tcp/0@lo 00000100:00100000:2.0:1787190740.434837:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99f17c475880 x1874004695840512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787190740.434906:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695839872:0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.434966:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.435134:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874004695840768:0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435163:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.435186:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787190740.435192:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695840256:0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435214:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.435231:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695840896:0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.435273:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839872 00000100:00100000:2.0:1787190740.435280:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839872 00000100:00100000:2.0:1787190740.435352:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787190740.435362:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695839872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435481:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c476680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695839872:12345-0@lo:400:kworker.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.435489:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787190740.435514:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840768 00000100:00100000:2.0:1787190740.435524:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840768 00000100:00100000:2.0:1787190740.435551:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840256 00000100:00100000:2.0:1787190740.435554:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840256 00000100:00100000:2.0:1787190740.435566:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840896 00000100:00100000:2.0:1787190740.435569:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840896 00000100:00100000:2.0:1787190740.435583:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190740.435588:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874004695840768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435784:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c474a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1874004695840768:12345-0@lo:400:kworker.0 Request processed in 194us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.435791:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787190740.435807:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787190740.435813:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695840256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435924:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695840256:12345-0@lo:400:kworker.0 Request processed in 45us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.435931:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787190740.435943:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787190740.435949:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695840896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.435974:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695840896:12345-0@lo:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.435979:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787190740.436094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1666cc000 x1874004695840256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.436107:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695840256:0@lo:400:kworker.0 00010000:00080000:2.0:1787190740.436117:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c474e00 x1874004695840896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.436125:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695840896:0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.436141:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695839872:0@lo:400:kworker.0 00010000:00080000:2.0:1787190740.436148:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c477100 x1874004695840768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.436155:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3651:1874004695840768:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436246:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695839744:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436280:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436333:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695840640:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436353:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436371:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695841152:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436393:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436409:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787190740.436425:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695840384:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436446:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436463:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874004695841024:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436498:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436527:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840384 00000100:00100000:3.0:1787190740.436531:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840384 00000100:00100000:3.0:1787190740.436558:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787190740.436564:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695840384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436599:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695840384:12345-0@lo:400:kworker.0 Request processed in 35us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.436613:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787190740.436641:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840640 00000100:00100000:3.0:1787190740.436644:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840640 00000100:00100000:3.0:1787190740.436662:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841152 00000100:00100000:3.0:1787190740.436665:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841152 00000100:00100000:3.0:1787190740.436683:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841024 00000100:00100000:3.0:1787190740.436686:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841024 00000100:00100000:3.0:1787190740.436698:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190740.436703:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695840640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436733:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695840640:12345-0@lo:400:kworker.0 Request processed in 30us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.436738:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787190740.436749:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787190740.436756:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695841152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436779:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695841152:12345-0@lo:400:kworker.0 Request processed in 25us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.436784:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787190740.436795:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787190740.436801:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874004695841024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.436825:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3654:x1874004695841024:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.436830:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1787190740.436845:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190740.436849:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787190740.436879:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695840000:0@lo:8:kworker.0 00000100:00100000:3.0:1787190740.436911:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436937:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695840128:0@lo:8:kworker.0 00000100:00100000:3.0:1787190740.436962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.436979:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695840512:0@lo:8:kworker.0 00000100:00100000:2.0:1787190740.437272:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695839744 00000100:00100000:2.0:1787190740.437277:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695839744 00000100:00100000:2.0:1787190740.437326:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787190740.437333:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:3654:x1874004695839744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190740.437426:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:3654:x1874004695839744:12345-0@lo:400:kworker.0 Request processed in 93us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.437432:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787190740.439573:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.439663:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840000 00000100:00100000:3.0:1787190740.439672:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840000 00000100:00100000:3.0:1787190740.439711:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840128 00000100:00100000:3.0:1787190740.439714:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840128 00000100:00100000:3.0:1787190740.439722:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695840512 00000100:00100000:3.0:1787190740.439725:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695840512 00000100:00100000:3.0:1787190740.439736:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787190740.439743:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3650:x1874004695840000:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787190740.439773:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:3.0:1787190740.439801:0:24266:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb4cbe 00002000:00100000:3.0:1787190740.439813:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99f17d9ac800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787190740.439817:0:24266:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1787190740.439820:0:24266:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787190740.439901:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787190740.439925:0:24266:0:(import.c:65:import_set_state_nolock()) ffff99f17d9ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190740.439978:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1874004695840000:12345-0@lo:8:kworker.0 Request processed in 234us (3065us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.439984:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190740.440117:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190740.440124:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874004695840128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787190740.440141:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:0.0:1787190740.440162:0:24264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdedcc04674eb4cc5 00002000:00100000:0.0:1787190740.440170:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99f17d9c7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787190740.440173:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787190740.440175:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190740.440359:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190740.440375:0:24264:0:(import.c:65:import_set_state_nolock()) ffff99f17d9c5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190740.440410:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1874004695840128:12345-0@lo:8:kworker.0 Request processed in 286us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190740.440416:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190740.440437:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190740.440441:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3650:x1874004695840512:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787190740.440455:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 717 last 0 00000020:00000080:0.0:1787190740.440486:0:24264:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdedcc04674eb4ccc 00002000:00100000:0.0:1787190740.440493:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff99f17d9c7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1787190740.440496:0:24264:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1787190740.440498:0:24264:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787190740.440519:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1787190740.440532:0:24264:0:(import.c:65:import_set_state_nolock()) ffff99f17d9c0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190740.440562:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1874004695840512:12345-0@lo:8:kworker.0 Request processed in 119us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190740.440568:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787190740.440595:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c474700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695840384:0@lo:400:kworker.0 00010000:00080000:3.0:1787190740.440622:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c475180 x1874004695841024/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.440635:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3654:1874004695841024:0@lo:400:kworker.0 00000100:00100000:3.0:1787190740.440657:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695839744:0@lo:400:kworker.0 00010000:00080000:3.0:1787190740.440669:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c475f80 x1874004695840640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.440677:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695840640:0@lo:400:kworker.0 00010000:00080000:3.0:1787190740.440693:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c477b80 x1874004695841152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.440702:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695841152:0@lo:400:kworker.0 00010000:00080000:3.0:1787190740.440750:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1666ce300 x1874004695840000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.440758:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190740.440764:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787190740.440772:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190740.440776:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787190740.440778:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f15ffbd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190740.440803:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787190740.440808:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695840000:0@lo:8:kworker.0 00010000:00080000:3.0:1787190740.440821:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1666cca80 x1874004695840128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190740.440828:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787190740.440831:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1787190740.440836:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190740.440839:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787190740.440841:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f17c31d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190740.440849:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787190740.440871:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3650:1874004695840128:0@lo:8:kworker.0 00010000:00080000:3.0:1787190740.440887:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c475880 x1874004695840512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787190765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787190740.440896:0:3650:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1787190740.440901:0:3650:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787190740.440903:0:3650:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787190740.440905:0:3650:0:(import.c:65:import_set_state_nolock()) ffff99f143e76000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787190740.440914:0:3650:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787190740.440918:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3650:1874004695840512:0@lo:8:kworker.0 00000004:00080000:3.0:1787190740.440951:0:22782:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787190740.441162:0:22782:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 717605873840ns, next at 0ns, rc = 0 00080000:00080000:3.0:1787190740.441168:0:22782:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1787190740.442012:0:22785:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787190740.442036:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1874004695841408:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787190740.442077:0:22783:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1787190740.442086:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190740.442090:0:22783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1874004695841664:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787190740.442109:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f175e460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190740.442114:0:22783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787190740.442122:0:22784:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787190740.442128:0:22783:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158dc2e40 going to sleep for 11 seconds 00000004:00080000:0.0:1787190740.442158:0:23502:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000004:00080000:2.0:1787190740.442171:0:22784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 717606883470ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787190740.442171:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695841920:0@lo:7:osp-pre-1-1.0 00080000:00080000:2.0:1787190740.442176:0:22784:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1787190740.442191:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695841536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190740.442194:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190740.442208:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158dc2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190740.442218:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787190740.442219:0:23501:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787190740.442237:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190740.442242:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695841280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190740.442262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1787190740.442263:0:23501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 717606975098ns, next at 0ns, rc = 0 00080000:00080000:0.0:1787190740.442267:0:23501:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1787190740.442301:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841536 00000100:00100000:2.0:1787190740.442308:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841536 00000100:00100000:2.0:1787190740.442356:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841280 00000100:00100000:2.0:1787190740.442360:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841280 00000100:00100000:2.0:1787190740.442373:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190740.442378:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841408 00000100:00100000:2.0:1787190740.442381:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1874004695841536:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190740.442381:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841408 00002000:00000024:2.0:1787190740.442398:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190740.442400:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841664 00000100:00100000:0.0:1787190740.442402:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841664 00000100:00100000:0.0:1787190740.442421:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841920 00000100:00100000:0.0:1787190740.442423:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841920 00000100:00100000:0.0:1787190740.442439:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190740.442442:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874004695841536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190740.442444:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:22785:x1874004695841408:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787190740.442448:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787190740.442462:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787190740.442480:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874004695841280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190740.442488:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:2.0:1787190740.442512:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c477480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1874004695841280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.442517:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1787190740.442537:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787190740.442541:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787190740.442560:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c477100 x1874004695841280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.442576:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695841280:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787190740.442587:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f1483fea00 x1874004695841536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.442596:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695841536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190740.442647:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787190740.442655:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22783:x1874004695841664:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787190740.442666:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695841792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190740.442691:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190740.442719:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695841792 00000100:00100000:0.0:1787190740.442723:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695841792 00000100:00100000:0.0:1787190740.442742:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787190740.442747:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874004695841792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787190740.442757:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915866112 avail 3684343808 00000100:00100000:0.0:1787190740.442806:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3653:x1874004695841792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190740.442812:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787190740.442836:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17d99d180 x1874004695841792/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787190756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190740.442848:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695841792:0@lo:13:osp-pre-1-1.0 00000004:00080000:3.0:1787190740.444722:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1787190740.447143:0:24266:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1787190740.447156:0:24266:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1787190740.447163:0:24266:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000004:00080000:2.0:1787190740.454098:0:23491:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1787190740.459685:0:24811:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1787190740.459696:0:24811:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1787190740.459702:0:24811:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:3.0:1787190740.466343:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787190740.476430:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.476448:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.476475:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.476480:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.476486:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.476506:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.476517:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.476525:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.476551:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.476982:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.476989:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.477004:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.477008:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.477017:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.477047:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.477055:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54b1a73/0xdedcc04674eb4cd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.477075:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.477077:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.477078:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.479652:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.479666:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.479683:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.479688:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.479693:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.479720:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.479731:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.479739:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.479766:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.480160:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.480168:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480176:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.480181:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480188:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480206:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480213:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd6f7061/0xdedcc04674eb4cda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480238:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.480240:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.480242:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.480340:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.480347:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480356:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.480359:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.480363:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480371:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480378:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480394:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480409:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.480494:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.480499:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480508:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039fc00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.480512:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480520:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480531:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.480538:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.480540:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.480541:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.480568:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073f00908/0xdedcc04674eb4ce1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.480840:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.480847:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480855:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.480858:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.480862:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480870:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480877:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480884:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.480948:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190740.486037:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.486049:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.486067:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.486072:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.486090:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.486106:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.486116:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.486124:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487058:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.487068:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487080:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6600 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.487085:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487104:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487123:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487131:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb38b7a0/0xdedcc04674eb4ce8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487151:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.487154:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487161:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667ba800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.487165:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487172:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487181:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.487189:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.487191:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.487197:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787190740.490502:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787190740.490516:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490544:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1787190740.490549:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190740.490555:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490581:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490592:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490605:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490704:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787190740.490716:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.490723:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490731:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.490736:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490744:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490880:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490890:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.490907:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.490909:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.490910:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.491682:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787190740.491691:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4cef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.492405:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.494700:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.494715:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.494735:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.494741:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.494748:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.494877:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.494891:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.494899:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.494932:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.495224:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.495232:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.495241:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.495245:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.495255:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.495305:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.495314:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4cfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.495332:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.495334:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.495336:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787190740.495506:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787190740.495520:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.495530:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1787190740.495534:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190740.495538:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.495550:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.495558:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.495668:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.495717:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.495957:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.495963:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.495972:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.495976:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.496067:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.496084:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.496091:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008515fe60/0xdedcc04674eb4d04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.496110:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.496112:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.496114:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787190740.497664:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787190740.497677:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.497692:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1787190740.497697:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190740.497702:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.497715:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.497730:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.497737:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.497907:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.497914:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.497922:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.497925:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.497928:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.497938:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.497946:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.497959:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.497984:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1787190740.501819:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.501834:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.501853:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.501858:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.501863:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.501880:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.501891:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.501899:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503760:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787190740.503774:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503787:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.503792:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503804:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503826:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503833:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c0b0b7d3/0xdedcc04674eb4d0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503881:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190740.503886:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503893:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.503896:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503904:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503916:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503924:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.503927:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503933:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.503936:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503944:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503975:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.503984:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.503985:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.503987:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.504750:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787190740.504759:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000293f4967/0xdedcc04674eb4d12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505509:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.505518:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4d19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505545:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.505887:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.505901:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505915:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.505919:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.505926:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505938:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505949:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505956:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505971:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.505978:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.505983:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.505991:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.505995:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506004:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506027:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506034:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4d20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506048:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.506050:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.506052:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.506395:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.506401:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506464:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.506476:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.506482:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506492:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506500:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506507:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506568:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787190740.506841:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.506847:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506856:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.506859:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.506863:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506873:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506881:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.506888:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506915:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190740.506921:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506929:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.506932:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506941:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506955:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506962:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6bccca3/0xdedcc04674eb4d27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506978:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.506986:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.506993:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.506996:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507004:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507014:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507021:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.507023:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.507025:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.507087:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.507092:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4d2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.507424:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.507430:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.507445:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.507449:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.507454:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.507464:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.507482:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.507490:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507586:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.507591:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507599:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.507602:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507610:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507622:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.507636:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.507637:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.507639:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.507699:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.507704:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4d35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.507991:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.507997:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508006:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.508009:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.508012:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508032:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508041:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508048:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508113:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.508118:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508126:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.508129:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508137:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508149:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508157:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.508158:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.508160:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.508218:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.508223:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4d3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.508551:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.508558:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508567:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.508570:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.508574:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508583:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508604:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.508611:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508655:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.508660:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508666:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.508670:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508685:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508696:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.508704:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.508706:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.508708:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.508765:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.508770:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4d43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.509005:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.509012:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.509021:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.509024:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.509029:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.509038:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.509045:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.509051:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.509330:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.509336:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.509344:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.509347:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.509351:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.509360:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.509367:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.509384:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509488:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787190740.509494:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509502:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d10000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.509505:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509513:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509527:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509535:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190740.509538:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509549:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7600 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190740.509552:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509560:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509569:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.509576:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.509577:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.509579:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.513538:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.514523:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787190740.514536:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8f39ef/0xdedcc04674eb4d4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.515277:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.515425:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.515434:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.515450:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.515456:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.515462:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.515487:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.515496:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.515504:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.515527:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.516579:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.516589:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.516601:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.516606:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.516616:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.516636:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.516643:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031d207d7/0xdedcc04674eb4d58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.516663:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.516671:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.516674:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.516786:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.516795:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.516810:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.516814:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.516820:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.516829:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.516837:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.516844:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.516961:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.516968:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4d51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.517660:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.517667:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.517678:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.517681:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.517686:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.517696:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.517704:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.517710:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519798:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190740.519813:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519828:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.519833:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519845:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519867:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519877:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.519881:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519888:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7a00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.519890:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519898:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519908:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.519925:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.519927:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.519929:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.520126:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787190740.520134:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.520528:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.521699:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787190740.521711:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf52b216/0xdedcc04674eb4d66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.521738:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.521746:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.521757:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.521762:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.521767:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.521791:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.521801:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.521808:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.521822:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.522072:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.522078:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.522087:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.522090:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.522098:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.522112:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.522119:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f35833b/0xdedcc04674eb4d6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.522133:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.522134:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.522136:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.522141:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.522214:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.522220:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.522228:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.522231:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.522235:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.522246:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.522253:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.522260:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.522522:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.522528:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.522535:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.522538:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.522542:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.522550:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.522557:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.522574:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.522614:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787190740.524721:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190740.524740:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524753:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.524757:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524767:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524785:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524793:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000666a2bfb/0xdedcc04674eb4d74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524812:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.524816:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524822:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.524826:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524834:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524853:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.524874:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.524876:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.524878:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.524906:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.525188:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787190740.525197:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4d7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.526433:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.526444:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.526458:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.526462:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.526477:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.526491:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.526500:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.526508:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.526538:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.528660:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.528673:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.528686:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.528691:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.528701:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.528722:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.528729:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4d82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.528747:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.528749:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.528756:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787190740.529334:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1787190740.529343:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.529356:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=717s v=(0 0) 00010000:00010000:1.0:1787190740.529361:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787190740.529366:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.529378:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.529387:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190740.529400:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190740.529716:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.529722:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.529731:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.529734:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.529738:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.529748:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.529756:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.529762:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.529816:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.530150:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.530157:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530165:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667ba800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.530169:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530177:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530192:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530198:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acbe89db/0xdedcc04674eb4d90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530212:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.530215:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530221:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b5e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.530224:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530243:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530254:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530262:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.530264:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.530266:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.530514:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.530521:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530530:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.530534:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.530538:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530548:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530557:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530564:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530588:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787190740.530971:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.530977:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.530985:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.530989:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.531058:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531069:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531078:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531085:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531100:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787190740.531108:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.531112:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531119:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.531127:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531135:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531146:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531153:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c20f1800/0xdedcc04674eb4d97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531167:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.531170:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531176:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.531179:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531185:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531194:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531200:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043e036b8/0xdedcc04674eb4d9e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531215:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.531217:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.531218:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.531509:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.531515:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531523:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.531525:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.531530:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531538:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531545:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531551:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531563:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.531569:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.531573:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531587:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.531590:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531597:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531607:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531684:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9f7f470/0xdedcc04674eb4da5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.531699:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.531700:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.531702:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.532072:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.532079:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532088:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.532091:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.532095:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532104:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532117:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532125:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532138:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.532145:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.532148:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532153:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.532156:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532163:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532173:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532180:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4dac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532191:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.532197:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.532199:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.532587:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.532594:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532603:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.532606:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.532610:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532700:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532708:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532715:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532728:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.532736:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.532739:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532746:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.532749:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532767:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532777:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532783:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4db3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.532796:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.532797:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.532799:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.533228:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.533235:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533244:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.533247:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.533251:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533260:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533268:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533279:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533310:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.533318:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.533322:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533329:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.533332:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533339:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533350:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533358:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4dba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533368:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.533370:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.533371:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.533757:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.533770:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533778:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.533781:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.533785:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.533792:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.533794:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533803:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533809:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.533833:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.534016:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.534022:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.534030:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120600 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.534033:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.534053:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.534065:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.534073:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c19428/0xdedcc04674eb4dc1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.534088:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.534090:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.534091:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190740.534375:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787190740.534382:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca2743e/0xdedcc04674eb4d89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787190740.534507:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.534514:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.534523:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.534526:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.534530:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.534539:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.534552:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.534559:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.535803:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.536080:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.536088:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536100:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.536105:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536114:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536132:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536153:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009989704b/0xdedcc04674eb4dc8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536170:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.536171:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.536173:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.536179:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190740.536444:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.536451:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536462:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.536477:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.536483:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536496:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536505:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536512:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536526:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.536539:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.536543:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536550:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667ba400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.536553:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536560:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536571:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536578:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080c103ad/0xdedcc04674eb4dcf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.536593:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.536594:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.536595:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.536788:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.536795:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.536803:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.536806:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.536810:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.536819:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.536827:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.536834:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.536875:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.537207:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.537213:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.537223:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120a00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.537226:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.537244:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.537256:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.537264:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066a1bfa8/0xdedcc04674eb4dd6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.537278:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.537279:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.537281:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.537575:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.537582:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537591:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.537594:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.537598:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537607:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537800:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537809:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537824:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.537833:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.537836:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537842:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.537851:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537870:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537882:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537889:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f475bb85/0xdedcc04674eb4ddd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.537902:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.537903:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.537905:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190740.538175:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.538182:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538192:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.538195:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.538199:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538209:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538217:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538230:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538242:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787190740.538250:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190740.538254:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538261:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bbe00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190740.538265:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538273:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538284:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538310:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017861ea9/0xdedcc04674eb4de4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.538323:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.538325:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190740.538326:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.539221:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.539232:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539244:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.539248:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.539253:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539264:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539273:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539303:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539319:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.539328:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.539333:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539342:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.539346:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539353:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539366:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539394:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fd06236/0xdedcc04674eb4deb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.539489:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.539492:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.539493:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.540125:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.540139:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540149:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.540153:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.540157:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540168:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540176:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540184:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540203:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.540212:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.540217:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540224:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.540228:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540236:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540255:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540262:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c12b89eb/0xdedcc04674eb4df2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.540277:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.540279:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.540281:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190740.540704:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.540719:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.540729:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.540732:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.540736:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.540745:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.540753:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.540759:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.540779:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787190740.541166:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.541173:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541181:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.541185:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.541189:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541199:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541212:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541219:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541232:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787190740.541510:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.541516:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541524:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bae00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.541527:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541535:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541549:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541557:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d13af116/0xdedcc04674eb4df9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541584:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.541588:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541594:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bb200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.541597:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.541604:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190740.541736:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.541743:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541751:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.541755:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.541759:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541768:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541776:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541784:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.541802:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.542107:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542118:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000977a18b4/0xdedcc04674eb4e00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542134:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.542137:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542144:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667bbc00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.542148:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542167:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542180:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542188:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a2afdc6/0xdedcc04674eb4e07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542200:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.542202:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.542203:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.542213:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.542256:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.542261:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542270:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.542273:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.542278:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542324:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542334:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542346:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542375:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.542382:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.542386:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542393:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121a00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.542396:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542404:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542429:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542436:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c469be/0xdedcc04674eb4e0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.542451:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.542452:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.542454:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787190740.542746:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1787190740.542753:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.542761:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=717s v=(0 0) 00010000:00010000:0.0:1787190740.542764:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190740.542768:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.542777:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.542784:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.542790:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190740.542802:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.543303:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.543314:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543322:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1667ba200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.543326:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543334:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543346:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543352:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b63f97/0xdedcc04674eb4e15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543365:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.543367:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.543368:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.543845:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.543852:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543863:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.543867:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.543871:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543895:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543904:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543911:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543924:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.543933:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.543937:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543943:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121600 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.543946:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543953:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543978:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.543985:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038d621aa/0xdedcc04674eb4e1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.544520:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.544522:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.544524:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.545510:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.545520:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.545534:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.545539:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.545544:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.545556:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.545564:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.545571:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.545586:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.545610:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.546067:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.546090:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.546094:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.546102:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.546119:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.546127:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a23d305d/0xdedcc04674eb4e23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.546144:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.546146:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.546147:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.547124:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.547134:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547146:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.547149:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.547154:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547166:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547181:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547188:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547206:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.547215:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.547219:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547226:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.547229:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547237:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547250:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547257:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8728d76/0xdedcc04674eb4e2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.547271:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.547279:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.547280:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.548320:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.548330:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548342:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.548346:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.548352:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548363:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548372:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548380:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548397:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.548408:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.548695:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548703:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.548707:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548726:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548743:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548750:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae977e38/0xdedcc04674eb4e31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.548763:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.548765:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.548766:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787190740.549559:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.549568:0:24266:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.549579:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=717s v=(0 0) 00010000:00010000:3.0:1787190740.549583:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190740.549587:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.549597:0:24266:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.549606:0:24266:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550077:0:24266:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550094:0:24266:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.550106:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.550111:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550118:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.550122:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550130:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550146:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550154:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016fb30d8/0xdedcc04674eb4e38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.550169:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.550171:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.550173:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.553437:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.553454:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.553492:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.553497:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.553504:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.553518:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.553529:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.553537:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.553564:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.553728:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.553740:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.553749:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7600 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.553754:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.553763:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.553780:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.553788:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60d8448/0xdedcc04674eb4e3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.553808:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.553810:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.553812:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787190740.554035:0:24266:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1787190740.554133:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22783:x1874004695841664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 111474us (112013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.554143:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787190740.554204:0:22783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1874004695841664:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787190740.554220:0:22783:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1787190740.554261:0:22783:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1874004695842048:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787190740.554318:0:22783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190740.554340:0:22783:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1703d0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787190740.554356:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842048 00000100:00100000:3.0:1787190740.554362:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842048 00000100:00100000:3.0:1787190740.554397:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190740.554406:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695841920:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:2.0:1787190740.556670:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.556683:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.556700:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.556705:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.556711:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.556726:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.556748:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.556756:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.556778:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787190740.557182:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.557188:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.557198:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.557202:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.557206:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.557215:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.557223:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.557229:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.557257:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787190740.559899:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.559914:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.559929:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.559934:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.559946:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.559968:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.559977:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093a47264/0xdedcc04674eb4e46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560247:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.560253:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560272:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6c00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.560276:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560300:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560312:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560320:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d44c1cb7/0xdedcc04674eb4e4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.560333:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.560335:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.560337:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.560343:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.560669:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.560677:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.560689:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.560694:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.560700:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.560714:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.560722:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.560730:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.560746:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787190740.561754:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.561764:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.561777:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.561787:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.561793:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.561805:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.561815:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.561822:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.561836:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787190740.562096:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787190740.562103:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562112:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.562116:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562135:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787190740.562148:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1787190740.562150:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562153:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562159:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040173a94/0xdedcc04674eb4e54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562161:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.562165:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.562168:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562174:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.562178:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562178:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562185:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.562187:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562188:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562196:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562198:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562206:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562207:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787190740.562213:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb4e5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562234:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190740.562238:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562244:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:3.0:1787190740.562248:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562255:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562266:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562273:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d060f2c/0xdedcc04674eb4e62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190740.562303:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.562305:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190740.562307:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.562698:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.562736:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.562743:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562752:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.562755:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.562760:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562769:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562778:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.562785:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1787190740.562836:0:24263:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1787190740.562843:0:24263:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1787190740.562942:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695841920:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8532us (120741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190740.562952:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787190740.562987:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1787190740.563715:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787190740.563741:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22783:x1874004695842048:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787190740.563791:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1787190740.564343:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.564356:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.564367:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.564372:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.564382:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.564402:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.564410:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000937f3faf/0xdedcc04674eb4e69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.564428:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.564430:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.564431:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190740.564489:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695841920:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1787190740.564514:0:23502:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787190740.564556:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695842176:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787190740.564863:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.564892:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15a703b40 going to sleep for 11 seconds 00002000:00010000:2.0:1787190740.565677:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.565687:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565706:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.565711:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.565718:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565732:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565742:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565750:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565766:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.565775:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.565780:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565787:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6a00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.565791:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565799:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565825:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565833:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1c62ee9/0xdedcc04674eb4e70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.565847:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.565849:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.565851:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.567035:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.567045:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567059:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.567063:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.567069:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567080:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567090:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567098:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567123:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.567133:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.567137:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567145:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.567149:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567158:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567172:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567180:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e993b17c/0xdedcc04674eb4e77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.567195:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.567197:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.567199:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787190740.568744:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.568756:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568772:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.568782:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.568787:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568800:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568810:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568817:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568835:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.568846:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.568851:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568858:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a6e00 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.568862:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568870:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568886:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568905:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd374e28/0xdedcc04674eb4e7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.568920:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.568922:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.568924:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190740.569069:0:24266:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1787190740.569079:0:24266:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:2.0:1787190740.569523:0:24811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1787190740.569530:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569540:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=717s v=(0 0) 00010000:00010000:2.0:1787190740.569544:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190740.569548:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569558:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569567:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569647:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569672:0:24811:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787190740.569681:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787190740.569686:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569693:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:2.0:1787190740.569697:0:22747:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569706:0:22747:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569718:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.569726:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076e0449a/0xdedcc04674eb4e85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190740.570521:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.570524:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190740.570526:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787190740.570659:0:24811:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1787190740.570761:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22785:x1874004695841408:12345-0@lo:5:osp-pre-1-0.0 Request processed in 128312us (128670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.570771:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190740.570834:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1874004695841408:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787190740.570850:0:22785:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1787190740.570897:0:22785:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1874004695842304:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787190740.570928:0:22785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.570949:0:22785:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15a703a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190740.570965:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842176 00000100:00100000:2.0:1787190740.570970:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842176 00000100:00100000:2.0:1787190740.570995:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842304 00000100:00100000:2.0:1787190740.570998:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842304 00000100:00100000:2.0:1787190740.571013:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190740.571021:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695842176:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1787190740.571045:0:24811:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1787190740.571076:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c475500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695842176:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56us (6214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190740.571083:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190740.571108:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695842176:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787190740.571116:0:23502:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1787190740.571136:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695842432:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1787190740.571157:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.571167:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15a703b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787190740.571177:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842432 00000100:00100000:2.0:1787190740.571180:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842432 00000100:00100000:2.0:1787190740.571194:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190740.571200:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22785:x1874004695842304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787190740.571223:0:24811:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000001:00080000:3.0:1787190740.575127:0:24260:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1787190740.575174:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787190740.575332:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22783:x1874004695842048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11596us (21010us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787190740.575343:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787190740.575369:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787190740.575381:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695842432:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1787190740.576081:0:24263:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000001:00080000:2.0:1787190740.579419:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1787190740.579475:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1787190740.579481:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787190740.579635:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22785:x1874004695842304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8429us (8700us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1787190740.579646:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190740.579703:0:22785:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1787190740.579713:0:22785:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22785:1874004695842304:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787190740.579730:0:22785:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:2.0:1787190740.582450:0:22783:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1787190740.582477:0:22783:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22783:1874004695842048:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787190740.582494:0:22783:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:1.0:1787190740.601665:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23502:x1874004695842432:12345-0@lo:5:osp-pre-1-1.0 Request processed in 26281us (30500us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1787190740.601679:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787190740.601830:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23502:1874004695842432:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1787190740.601848:0:23502:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1787190740.601890:0:23502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1874004695842560:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787190740.601925:0:23502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190740.601958:0:23502:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15a703b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787190740.602094:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842560 00000100:00100000:1.0:1787190740.602100:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842560 00000100:00100000:1.0:1787190740.602145:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787190740.602154:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1874004695842560:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1787190740.602243:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23502:x1874004695842560:12345-0@lo:900:osp-pre-1-1.0 Request processed in 90us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190740.602250:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787190740.604571:0:23502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c474e00 x1874004695842560/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1787190756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787190740.604590:0:23502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23502:1874004695842560:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1787190740.627445:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190740.627483:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695842688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787190740.627558:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190740.627644:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842688 00000100:00100000:1.0:1787190740.627652:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842688 00000100:00100000:1.0:1787190740.627707:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190740.627718:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695842688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787190740.627756:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190740.627802:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695842688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190740.627810:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787190740.627906:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695842688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190740.630755:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695842816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190740.630828:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190740.630905:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842816 00000100:00100000:1.0:1787190740.630913:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842816 00000100:00100000:1.0:1787190740.630963:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787190740.630973:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695842816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190740.631005:0:22764:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787190740.633533:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695842816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2552us (2695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190740.633547:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787190740.635010:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695842816:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1787190740.754972:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787190741.212603:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787190741.212626:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f144dc0000 from 14 10000000:01000000:0.0:1787190741.212630:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787190741.212677:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.212690:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.212702:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190741.212731:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695842944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190741.212804:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190741.212849:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f15a702d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190741.212913:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695842944 00000100:00100000:0.0:1787190741.212922:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695842944 00000100:00100000:0.0:1787190741.212969:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787190741.212978:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1551e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695842944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190741.212993:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190741.213006:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667ba400/0xdedcc04674eb4e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4e8c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213029:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667ba400/0xdedcc04674eb4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4e8c expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213040:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667ba400/0xdedcc04674eb4e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4e8c expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213050:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667ba400, rc 0) 00000100:00100000:0.0:1787190741.213087:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1551e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695842944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190741.213100:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787190741.213151:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695842944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190741.213165:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4e93 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213172:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4e93 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190741.213217:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843072:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787190741.213248:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190741.213265:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f146dbec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190741.213278:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843072 00000100:00100000:0.0:1787190741.213281:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843072 00000100:00100000:0.0:1787190741.213323:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787190741.213330:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1453c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695843072:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787190741.213343:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787190741.213359:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787190741.213362:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787190741.213434:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1453c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695843072:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190741.213441:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787190741.213488:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843072:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787190741.213549:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787190741.213556:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4e93 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213572:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bbe00/0xdedcc04674eb4e8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4e93 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190741.213582:0:22756:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787190741.213584:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99f15e512000 from 14 10000000:01000000:0.0:1787190741.213586:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787190741.213601:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213608:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213616:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190741.213627:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190741.213652:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190741.213665:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f146dbec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190741.213676:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843200 00000100:00100000:0.0:1787190741.213679:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843200 00000100:00100000:0.0:1787190741.213699:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787190741.213705:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1453c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695843200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190741.213712:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190741.213720:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bb000/0xdedcc04674eb4ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb4e9a expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213733:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bb000/0xdedcc04674eb4ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb4e9a expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213753:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bb000/0xdedcc04674eb4ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4e9a expref: 24 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213760:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bb000, rc 0) 00000100:00100000:0.0:1787190741.213786:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1453c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695843200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190741.213792:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787190741.213823:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190741.213833:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4ea1 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.213841:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb4ea1 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190741.213880:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787190741.213909:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190741.213923:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f146dbec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190741.213934:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843328 00000100:00100000:0.0:1787190741.213937:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843328 00000100:00100000:0.0:1787190741.213957:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787190741.213963:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695843328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787190741.213972:0:22751:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787190741.213982:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787190741.213985:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1787190741.214040:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695843328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 76us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190741.214053:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787190741.214083:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695843328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787190741.214118:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787190741.214124:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4ea1 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190741.214131:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bb400/0xdedcc04674eb4e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb4ea1 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787190741.586964:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787190741.778529:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190742.802522:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190743.829497:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190744.850399:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190745.237530:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787190745.237552:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695843456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787190745.237630:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.237731:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843456 00000100:00100000:0.0:1787190745.237739:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843456 00000100:00100000:0.0:1787190745.237811:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190745.237820:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695843456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1787190745.237850:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190745.237896:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695843456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.237902:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190745.237946:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c477b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695843456:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787190745.239577:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190745.746679:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695843584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190745.746743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747019:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695843712:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190745.747050:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747074:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695844224:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.747097:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747113:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695844736:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.747136:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747165:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1787190745.747173:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695844096:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.747198:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747212:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695844608:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.747231:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747245:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695845120:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.747263:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.747301:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843584 00000100:00100000:0.0:1787190745.747309:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843584 00000100:00100000:0.0:1787190745.747358:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190745.747367:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695843584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787190745.747395:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787190745.747443:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c475180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695843584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.747450:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190745.747493:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695843840:0@lo:400:kworker.0 00000100:00100000:3.0:1787190745.747749:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844224 00000100:00100000:3.0:1787190745.747753:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844224 00000100:00100000:3.0:1787190745.747776:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844736 00000100:00100000:3.0:1787190745.747779:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844736 00000100:00100000:3.0:1787190745.747806:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844608 00000100:00100000:3.0:1787190745.747809:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844608 00000100:00100000:3.0:1787190745.747820:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845120 00000100:00100000:3.0:1787190745.747822:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845120 00000100:00100000:3.0:1787190745.747835:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787190745.747842:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695844224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190745.747931:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c475f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695843584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787190745.747947:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787190745.747952:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17dde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695845248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190745.747976:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190745.748004:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843712 00000100:00100000:2.0:1787190745.748008:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843712 00000100:00100000:2.0:1787190745.748031:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845248 00000100:00100000:2.0:1787190745.748033:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845248 00000100:00100000:2.0:1787190745.748045:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190745.748051:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695843712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787190745.748075:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1787190745.748109:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695843712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748116:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787190745.748130:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190745.748136:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695845248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1787190745.748151:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1787190745.748180:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695845248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748194:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787190745.748222:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695845248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190745.748375:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190745.748384:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695844736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190745.748417:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695844736:12345-0@lo:400:kworker.0 Request processed in 35us (1280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748434:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787190745.748449:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190745.748455:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695844608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190745.748481:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695844608:12345-0@lo:400:kworker.0 Request processed in 27us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748487:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787190745.748498:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190745.748506:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695845120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190745.748880:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695845120:12345-0@lo:400:kworker.0 Request processed in 375us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748887:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787190745.748912:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844096 00000100:00100000:2.0:1787190745.748917:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844096 00000100:00100000:2.0:1787190745.748948:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787190745.748954:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695844096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190745.748985:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695844096:12345-0@lo:400:kworker.0 Request processed in 32us (1786us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190745.748991:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787190745.754590:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695844224:12345-0@lo:400:kworker.0 Request processed in 6735us (7478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190745.754606:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787190745.758206:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758263:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695844352:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758336:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758358:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695844864:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758383:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758411:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695845376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190745.758446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758465:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1787190745.758471:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695843968:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758505:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758601:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695844480:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758649:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ddeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695844992:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758669:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758686:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695845504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190745.758705:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190745.758741:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844352 00000100:00100000:0.0:1787190745.758761:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844352 00000100:00100000:0.0:1787190745.758876:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843968 00000100:00100000:0.0:1787190745.758880:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843968 00000100:00100000:0.0:1787190745.758900:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787190745.758910:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695844352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.758970:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695844352:12345-0@lo:400:kworker.0 Request processed in 62us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.758977:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787190745.758993:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787190745.758999:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695843968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.759027:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695843968:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759033:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787190745.759050:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787190745.759055:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190745.759057:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190745.759060:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190745.759072:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845376 00000100:00100000:0.0:1787190745.759076:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845376 00000100:00100000:0.0:1787190745.759098:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845504 00000100:00100000:0.0:1787190745.759101:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845504 00000100:00100000:0.0:1787190745.759119:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190745.759125:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695845376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787190745.759138:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190745.759165:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695845376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759170:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190745.759181:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190745.759187:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695845504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1787190745.759195:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787190745.759218:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695845504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759224:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190745.759356:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695843840 00000100:00100000:0.0:1787190745.759361:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695843840 00000100:00100000:0.0:1787190745.759386:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787190745.759393:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3651:x1874004695843840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.759438:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3651:x1874004695843840:12345-0@lo:400:kworker.0 Request processed in 45us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759444:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787190745.759475:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844864 00000100:00100000:0.0:1787190745.759479:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844864 00000100:00100000:0.0:1787190745.759505:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844992 00000100:00100000:0.0:1787190745.759508:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844992 00000100:00100000:0.0:1787190745.759733:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787190745.759855:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695844864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.759900:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695844864:12345-0@lo:400:kworker.0 Request processed in 160us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759907:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787190745.759919:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787190745.759925:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695844992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.759952:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695844992:12345-0@lo:400:kworker.0 Request processed in 27us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.759957:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1787190745.759984:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190745.759987:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190745.759989:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190745.760026:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695844096:0@lo:400:kworker.0 00010000:00080000:0.0:1787190745.760042:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17dde8000 x1874004695844608/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760052:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695844608:0@lo:400:kworker.0 00010000:00080000:0.0:1787190745.760064:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17ddea680 x1874004695845120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760073:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695845120:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760088:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695843712:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1787190745.760100:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17cdf4700 x1874004695844224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760108:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695844224:0@lo:400:kworker.0 00010000:00080000:0.0:1787190745.760120:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17dde8a80 x1874004695844736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760135:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17dde8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695844736:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760176:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695843968:0@lo:400:kworker.0 00010000:00080000:0.0:1787190745.760187:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17ddeb480 x1874004695844992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760196:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695844992:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760211:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695845504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190745.760224:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695845376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190745.760233:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695843840:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760243:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695844352:0@lo:400:kworker.0 00010000:00080000:0.0:1787190745.760253:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17ddeaa00 x1874004695844864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190745.760260:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ddeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695844864:0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760338:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695844480 00000100:00100000:0.0:1787190745.760343:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695844480 00000100:00100000:0.0:1787190745.760378:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190745.760385:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695844480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190745.760433:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3651:x1874004695844480:12345-0@lo:400:kworker.0 Request processed in 49us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190745.760440:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787190745.760463:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cdf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695844480:0@lo:400:kworker.0 00010000:00010000:2.0:1787190745.877152:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787190746.264815:0:25438:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg222-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00080000:1.0:1787190746.774722:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1787190746.899906:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787190747.174549:0:25490:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190747.174882:0:25490:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1787190747.922785:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1787190748.169800:0:25540:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1787190748.170050:0:25540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1787190748.179953:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787190748.387110:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190748.388596:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672661760 00000100:00100000:0.0:1787190748.388621:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672661760 00000100:00100000:0.0:1787190748.388662:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:0.0:1787190748.388670:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2417:x1874004672661760:12345-192.168.202.22@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787190748.388695:0:22753:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 08bd72b5-145e-4690-95a2-5b26cc20c570@192.168.202.22@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:0.0:1787190748.388722:0:22753:0:(genops.c:1385:class_connect()) connect: client 08bd72b5-145e-4690-95a2-5b26cc20c570, cookie 0xdedcc04674eb4ea8 00000100:00080000:0.0:1787190748.388864:0:22753:0:(import.c:65:import_set_state_nolock()) ffff99f17d9c0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190748.389167:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+5:2417:x1874004672661760:12345-192.168.202.22@tcp:250:mount.lustre.0 Request processed in 494us (2064us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190748.389175:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 115 00000100:00100000:2.0:1787190748.403032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.403095:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672661888 00000100:00100000:1.0:1787190748.403106:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672661888 00000100:00100000:1.0:1787190748.403163:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:1.0:1787190748.403173:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+5:18097:x1874004672661888:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190748.403191:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190748.403208:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4eaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d11296d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.403236:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d11296d expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.403247:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b5600/0xdedcc04674eb4eaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d11296d expref: 6 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.403273:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b5600, rc 0) 00000100:00100000:1.0:1787190748.403361:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+6:18097:x1874004672661888:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 189us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.403368:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 116 00000100:00100000:0.0:1787190748.405440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.405507:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662016 00000100:00100000:2.0:1787190748.405517:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662016 00000100:00100000:2.0:1787190748.405561:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:2.0:1787190748.405572:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+6:18097:x1874004672662016:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190748.405874:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+6:18097:x1874004672662016:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 302us (441us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787190748.405883:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 117 00000100:00100000:3.0:1787190748.413089:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.413261:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662144 00000100:00100000:2.0:1787190748.413271:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662144 00000100:00100000:2.0:1787190748.413405:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:2.0:1787190748.413418:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+6:18097:x1874004672662144:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787190748.413436:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190748.413451:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1700a6000/0xdedcc04674eb4eb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112974 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.413485:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1700a6000/0xdedcc04674eb4eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112974 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.413496:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1700a6000/0xdedcc04674eb4eb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112974 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.413505:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1700a6000, rc 0) 00000100:00100000:2.0:1787190748.413562:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+7:18097:x1874004672662144:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 146us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.413596:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 118 00000100:00100000:0.0:1787190748.416387:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.416742:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662272 00000100:00100000:2.0:1787190748.416752:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662272 00000100:00100000:2.0:1787190748.416802:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:2.0:1787190748.416811:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+7:18097:x1874004672662272:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190748.416968:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18097:x1874004672662272:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 157us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.416975:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 119 00000100:00100000:0.0:1787190748.425914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.425972:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662400 00000100:00100000:2.0:1787190748.425982:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662400 00000100:00100000:2.0:1787190748.426047:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:2.0:1787190748.426056:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18097:x1874004672662400:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787190748.426214:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18097:x1874004672662400:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 158us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.426223:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 120 00000100:00100000:3.0:1787190748.428250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.428354:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662528 00000100:00100000:2.0:1787190748.428362:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662528 00000100:00100000:2.0:1787190748.428424:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:2.0:1787190748.428435:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662528:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190748.428604:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662528:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 170us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.428612:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 121 00000100:00100000:0.0:1787190748.451429:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.451915:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662656 00000100:00100000:1.0:1787190748.451926:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662656 00000100:00100000:1.0:1787190748.451988:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:1.0:1787190748.451999:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662656:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190748.452162:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662656:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 164us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.452170:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 122 00000100:00100000:0.0:1787190748.456876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.456975:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662784 00000100:00100000:2.0:1787190748.456984:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662784 00000100:00100000:2.0:1787190748.457067:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:2.0:1787190748.457078:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662784:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190748.457384:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18115:x1874004672662784:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 306us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.457393:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 123 00000100:00100000:2.0:1787190748.468518:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.468741:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672662912 00000100:00100000:1.0:1787190748.468821:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672662912 00000100:00100000:1.0:1787190748.468874:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:1.0:1787190748.468885:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+8:18097:x1874004672662912:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190748.468904:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190748.468921:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b5c00/0xdedcc04674eb4ebd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d1129a5 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.468954:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b5c00/0xdedcc04674eb4ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129a5 expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.468967:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b5c00/0xdedcc04674eb4ebd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129a5 expref: 9 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190748.468976:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b5c00, rc 0) 00000100:00100000:1.0:1787190748.469103:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+9:18097:x1874004672662912:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 219us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.469111:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 124 00000100:00100000:1.0:1787190748.472988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190748.473109:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663040 00000100:00100000:0.0:1787190748.473121:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663040 00000100:00100000:0.0:1787190748.473180:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:0.0:1787190748.473191:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+9:18097:x1874004672663040:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787190748.473219:0:22751:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787190748.473244:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787190748.473248:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787190748.473251:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787190748.473254:0:22751:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1787190748.473257:0:22751:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787190748.477441:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160838c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+9:18097:x1874004672663040:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 4240us (4450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.477457:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 125 00000100:00100000:1.0:1787190748.480857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.480967:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663168 00000100:00100000:2.0:1787190748.480978:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663168 00000100:00100000:2.0:1787190748.481088:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:2.0:1787190748.481100:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f160839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+9:18097:x1874004672663168:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787190748.481118:0:22752:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190748.481134:0:22752:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d1129ac expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.481163:0:22752:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.481175:0:22752:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 10 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190748.481184:0:22752:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1700a6600, rc 0) 00000100:00100000:2.0:1787190748.481253:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f160839450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18097:x1874004672663168:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 155us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.481259:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 126 00000100:00100000:2.0:1787190748.483917:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.487767:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663296 00000100:00100000:1.0:1787190748.487780:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663296 00000100:00100000:1.0:1787190748.487833:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:1.0:1787190748.487840:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f16083a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18097:x1874004672663296:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787190748.487980:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f16083a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18097:x1874004672663296:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 139us (4072us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.487988:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 127 00000100:00100000:1.0:1787190748.491551:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190748.491672:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663424 00000100:00100000:2.0:1787190748.491685:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663424 00000100:00100000:2.0:1787190748.491765:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:2.0:1787190748.491776:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18097:x1874004672663424:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787190748.491934:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166625c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18097:x1874004672663424:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 160us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.491940:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 128 00000100:00100000:2.0:1787190748.501896:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.501968:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663552 00000100:00100000:1.0:1787190748.501978:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663552 00000100:00100000:1.0:1787190748.502078:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:1.0:1787190748.502090:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18121:x1874004672663552:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190748.502255:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18121:x1874004672663552:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 167us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.502263:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 129 00000100:00100000:3.0:1787190748.508166:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.508272:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663680 00000100:00100000:1.0:1787190748.508283:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663680 00000100:00100000:1.0:1787190748.508386:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:1.0:1787190748.508420:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18121:x1874004672663680:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190748.508579:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18121:x1874004672663680:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 161us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.508588:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 130 00000100:00100000:0.0:1787190748.550037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190748.550084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190748.550164:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663808 00000100:00100000:3.0:1787190748.550175:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663808 00000100:00100000:3.0:1787190748.550215:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664064 00000100:00100000:3.0:1787190748.550218:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664064 00000100:00100000:3.0:1787190748.550238:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:3.0:1787190748.550246:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2417:x1874004672663808:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787190748.550274:0:22759:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0dd54dd8-130e-44a0-a5c2-68ac863166bc@192.168.202.22@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:3.0:1787190748.550473:0:22759:0:(genops.c:1385:class_connect()) connect: client 0dd54dd8-130e-44a0-a5c2-68ac863166bc, cookie 0xdedcc04674eb4ecb 00000004:00100000:3.0:1787190748.550557:0:22759:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787190748.550891:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787190748.550898:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2417:x1874004672664064:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787190748.550916:0:24032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0dd54dd8-130e-44a0-a5c2-68ac863166bc@192.168.202.22@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:1.0:1787190748.550947:0:24032:0:(genops.c:1385:class_connect()) connect: client 0dd54dd8-130e-44a0-a5c2-68ac863166bc, cookie 0xdedcc04674eb4ed2 00000004:00100000:1.0:1787190748.550959:0:24032:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787190748.551105:0:24032:0:(import.c:65:import_set_state_nolock()) ffff99f1587ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190748.551171:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2417:x1874004672664064:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 271us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.551179:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00080000:3.0:1787190748.556776:0:22759:0:(import.c:65:import_set_state_nolock()) ffff99f17d9ae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787190748.557011:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2417:x1874004672663808:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 6760us (6982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190748.557022:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:2.0:1787190748.557185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.561064:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664192 00000100:00100000:1.0:1787190748.561079:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664192 00000100:00100000:1.0:1787190748.561221:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:1.0:1787190748.561232:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:0:x1874004672664192:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787190748.561266:0:24032:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190748.561378:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:0:x1874004672664192:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 148us (4193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.561385:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00080000:2.0:1787190748.561451:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787190748.572136:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.572731:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672663936 00000100:00100000:1.0:1787190748.572813:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672663936 00000100:00100000:1.0:1787190748.572885:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787190748.572896:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:0:x1874004672663936:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787190748.572948:0:22760:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787190748.573041:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:0:x1874004672663936:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 147us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.573049:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00080000:1.0:1787190748.573099:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787190748.573584:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190748.573902:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664320 00000100:00100000:3.0:1787190748.573908:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664320 00000100:00100000:3.0:1787190748.573943:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787190748.573951:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664320:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787190748.573971:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787190748.574012:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664320:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 61us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190748.574019:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:0.0:1787190748.576451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190748.576712:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664448 00000100:00100000:1.0:1787190748.576723:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664448 00000100:00100000:1.0:1787190748.576881:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787190748.576891:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664448:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787190748.576993:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664448:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 104us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190748.577002:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:0.0:1787190748.580114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190748.580212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190748.580250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190748.580555:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664576 00000100:00100000:3.0:1787190748.580567:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664576 00000100:00100000:3.0:1787190748.581056:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664704 00000100:00100000:3.0:1787190748.581074:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664704 00000100:00100000:2.0:1787190748.581134:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664832 00000100:00100000:2.0:1787190748.581138:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664832 00000100:00100000:2.0:1787190748.581184:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:2.0:1787190748.581194:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ddea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664832:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:2.0:1787190748.581273:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ddea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664832:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 80us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190748.581280:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:0.0:1787190748.581676:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787190748.581683:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17dde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2417:x1874004672664576:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787190748.581710:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0dd54dd8-130e-44a0-a5c2-68ac863166bc@192.168.202.22@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:0.0:1787190748.581739:0:24266:0:(genops.c:1385:class_connect()) connect: client 0dd54dd8-130e-44a0-a5c2-68ac863166bc, cookie 0xdedcc04674eb4ed9 00002000:00100000:0.0:1787190748.581816:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0dd54dd8-130e-44a0-a5c2-68ac863166bc/ffff99f17d9c1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190748.581833:0:24266:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190748.582084:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787190748.582113:0:24266:0:(import.c:65:import_set_state_nolock()) ffff99f17d9c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190748.582148:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17dde8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2417:x1874004672664576:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 464us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190748.582154:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787190748.582170:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:0.0:1787190748.582174:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2417:x1874004672664704:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787190748.582189:0:24266:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0dd54dd8-130e-44a0-a5c2-68ac863166bc@192.168.202.22@tcp t0 exp 0000000000000000 cur 725 last 0 00000020:00000080:0.0:1787190748.582207:0:24266:0:(genops.c:1385:class_connect()) connect: client 0dd54dd8-130e-44a0-a5c2-68ac863166bc, cookie 0xdedcc04674eb4ee0 00002000:00100000:0.0:1787190748.582213:0:24266:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0dd54dd8-130e-44a0-a5c2-68ac863166bc/ffff99f1587fa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190748.582223:0:24266:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190748.585068:0:24266:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190748.585116:0:24266:0:(import.c:65:import_set_state_nolock()) ffff99f1587fd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190748.585179:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2417:x1874004672664704:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 2999us (4924us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190748.585205:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:1.0:1787190748.585578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190748.586921:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672664960 00000100:00100000:3.0:1787190748.586933:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672664960 00000100:00100000:3.0:1787190748.587247:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:3.0:1787190748.587258:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664960:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787190748.589595:0:22761:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2206us 00000004:00200000:3.0:1787190748.612645:0:22761:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787190748.612776:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18097:x1874004672664960:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 25515us (27193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190748.612788:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787190748.809934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190748.817680:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665088 00000100:00100000:3.0:1787190748.817699:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665088 00000100:00100000:3.0:1787190748.817783:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 13 00000100:00100000:3.0:1787190748.817795:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18144:x1874004672665088:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:3.0:1787190748.817819:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190748.817845:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb4ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d1129dd expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.817914:0:22758:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.817929:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.817946:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190748.818113:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190748.818118:0:22758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190748.818173:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.818206:0:22758:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb4ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129dd expref: 8 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.818226:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129dd expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190748.818235:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190748.818238:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190748.818242:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121c00, rc 0) 00000100:00100000:3.0:1787190748.818556:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18144:x1874004672665088:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 762us (8633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190748.818572:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 13 00010000:00010000:3.0:1787190748.948068:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190749.970647:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190750.355054:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695845632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787190750.355137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190750.355317:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845632 00000100:00100000:2.0:1787190750.355325:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845632 00000100:00100000:2.0:1787190750.355398:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787190750.355410:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695845632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787190750.355439:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1787190750.355502:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695845632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.355526:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787190750.355745:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190750.355921:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695845632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787190750.800891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190750.801032:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665216 00000100:00100000:3.0:1787190750.801042:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665216 00000100:00100000:3.0:1787190750.801123:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:3.0:1787190750.801135:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18196:x1874004672665216:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:3.0:1787190750.801173:0:22759:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787190750.801273:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cdf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18196:x1874004672665216:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 140us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190750.801280:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00080000:1.0:1787190750.801423:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190750.809100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190750.809173:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665344 00000100:00100000:1.0:1787190750.809185:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665344 00000100:00080000:3.0:1787190750.809255:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787190750.809266:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:1.0:1787190750.809278:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665344:12345-192.168.202.22@tcp:41:lfs.0 00000004:00000024:1.0:1787190750.809354:0:24032:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190750.809460:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665344:12345-192.168.202.22@tcp:41:lfs.0 Request processed in 184us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.809467:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:2.0:1787190750.818612:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190750.818832:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665472 00000100:00100000:0.0:1787190750.818852:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665472 00000100:00100000:0.0:1787190750.818933:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:0.0:1787190750.818944:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665472:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:0.0:1787190750.818971:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1787190750.819042:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665472:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 101us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190750.819048:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00080000:3.0:1787190750.819324:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787190750.822048:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190750.831427:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665600 00000100:00100000:2.0:1787190750.831443:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665600 00000100:00100000:2.0:1787190750.831538:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00080000:1.0:1787190750.831695:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190750.831984:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665600:12345-192.168.202.22@tcp:13:lfs.0 00002000:00000024:2.0:1787190750.832024:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787190750.832108:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18196:x1874004672665600:12345-192.168.202.22@tcp:13:lfs.0 Request processed in 562us (10071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.832789:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787190750.866755:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695845888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190750.866854:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190750.866971:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845888 00000100:00100000:3.0:1787190750.866979:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845888 00000100:00100000:3.0:1787190750.867037:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787190750.867047:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695845888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190750.867071:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787190750.867245:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695845888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190750.867253:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787190750.867274:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190750.867332:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c5eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695845888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190750.867637:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190750.867674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.868215:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695846016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190750.868249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.868277:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695846528:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.868328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.868346:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874004695847040:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.868365:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.868533:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846528 00000100:00100000:1.0:1787190750.868540:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846528 00000100:00100000:1.0:1787190750.868601:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787190750.868610:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695846528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.868657:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1874004695846528:12345-0@lo:400:kworker.0 Request processed in 49us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.868664:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787190750.868698:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695846272:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.868728:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.868753:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695846784:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.868776:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.868792:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874004695847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.868820:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846272 00000100:00100000:1.0:1787190750.868824:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846272 00000100:00100000:1.0:1787190750.868864:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787190750.868870:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3654:x1874004695846272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.868901:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3654:x1874004695846272:12345-0@lo:400:kworker.0 Request processed in 31us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.868906:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787190750.868946:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846784 00000100:00100000:1.0:1787190750.868949:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846784 00000100:00100000:1.0:1787190750.868973:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787190750.868980:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695846784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.869010:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695846784:12345-0@lo:400:kworker.0 Request processed in 31us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.869016:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787190750.869267:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874004695847552:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.869317:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.869352:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3652:1874004695846528:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.869366:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1787190750.869635:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847040 00000100:00100000:1.0:1787190750.869640:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847040 00000100:00100000:1.0:1787190750.869674:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847552 00000100:00100000:1.0:1787190750.869677:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847552 00000100:00100000:1.0:1787190750.869701:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190750.869708:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874004695847040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.869744:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1874004695847040:12345-0@lo:400:kworker.0 Request processed in 36us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.869750:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787190750.869762:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190750.869768:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874004695847552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.869793:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1874004695847552:12345-0@lo:400:kworker.0 Request processed in 25us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.869798:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787190750.869833:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.869906:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695846400:0@lo:400:kworker.0 00000100:00100000:2.0:1787190750.869988:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846016 00000100:00100000:2.0:1787190750.869993:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846016 00000100:00100000:2.0:1787190750.870025:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190750.870031:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695846016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1787190750.870061:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1787190750.870139:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695845760 00000100:00100000:3.0:1787190750.870143:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695845760 00000100:00100000:3.0:1787190750.870170:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787190750.870177:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695845760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190750.870202:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190750.879478:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695846272:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.879504:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695846784:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.879526:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1787190750.879539:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695846144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787190750.879714:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.879736:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695846656:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.879760:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.879792:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695847168:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.879816:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.879832:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695847680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190750.879969:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190750.880006:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847296 00000100:00100000:1.0:1787190750.880025:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847296 00000100:00100000:1.0:1787190750.880074:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847168 00000100:00100000:1.0:1787190750.880077:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847168 00000100:00100000:1.0:1787190750.880097:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787190750.880106:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874004695847296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.881003:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3654:x1874004695847296:12345-0@lo:400:kworker.0 Request processed in 893us (11165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.881013:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787190750.881038:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787190750.881046:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695847168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.881075:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695847168:12345-0@lo:400:kworker.0 Request processed in 31us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.881081:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787190750.881479:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695847168:0@lo:400:kworker.0 00010000:00080000:1.0:1787190750.881497:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c769c00 x1874004695847296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190750.881509:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c769c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3654:1874004695847296:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.883776:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846656 00000100:00100000:1.0:1787190750.883790:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846656 00000100:00100000:1.0:1787190750.883833:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847680 00000100:00100000:1.0:1787190750.883836:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847680 00000100:00100000:1.0:1787190750.883976:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787190750.883986:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1874004695846656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.884080:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3654:x1874004695846656:12345-0@lo:400:kworker.0 Request processed in 96us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.884087:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787190750.884957:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787190750.884969:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695847680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190750.884999:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1787190750.885044:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695847680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (5074us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.885051:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787190750.885107:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695846656:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.885233:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695847680:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1787190750.885311:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787190750.885328:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787190750.885331:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787190750.885361:0:24268:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1787190750.885370:0:24268:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1787190750.885972:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695846016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 15937us (17718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.885981:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787190750.886000:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846144 00000100:00100000:2.0:1787190750.886007:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846144 00000100:00080000:2.0:1787190750.886031:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190750.886054:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190750.886061:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695846144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190750.886079:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1787190750.886134:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695846144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (6420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.886155:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787190750.886189:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1483fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695846144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787190750.890685:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695845760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 20496us (22997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190750.890701:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787190750.890831:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17d99ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695845760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190750.892543:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.892664:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695846912:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.892716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.897675:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695847424:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.897740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190750.898045:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1787190750.898076:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695846016:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190750.898093:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3652:1874004695847040:0@lo:400:kworker.0 00010000:00080000:0.0:1787190750.898107:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17c769180 x1874004695847552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190750.898132:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3652:1874004695847552:0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.906013:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847424 00000100:00100000:1.0:1787190750.906031:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847424 00000100:00100000:1.0:1787190750.906138:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787190750.906151:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695847424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190750.906258:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695847424:12345-0@lo:400:kworker.0 Request processed in 110us (8517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190750.906265:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787190750.906649:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190750.906690:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695847424:0@lo:400:kworker.0 00000100:00100000:3.0:1787190750.906940:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846400 00000100:00100000:3.0:1787190750.906946:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846400 00000100:00100000:2.0:1787190750.907055:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695846912 00000100:00100000:2.0:1787190750.907059:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695846912 00000100:00100000:2.0:1787190750.907096:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190750.907104:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695846400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190750.907166:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695846400:12345-0@lo:400:kworker.0 Request processed in 63us (14886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.907173:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787190750.907187:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787190750.907194:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695846912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190750.907222:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695846912:12345-0@lo:400:kworker.0 Request processed in 30us (14506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190750.907228:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787190750.908803:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695846400:0@lo:400:kworker.0 00000100:00100000:0.0:1787190750.908824:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695846912:0@lo:400:kworker.0 00010000:00010000:3.0:1787190750.996036:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190751.013830:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.014007:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665728 00000100:00100000:1.0:1787190751.014017:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665728 00000100:00100000:1.0:1787190751.014089:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:1.0:1787190751.014101:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+10:18228:x1874004672665728:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190751.014121:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190751.014143:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b4000/0xdedcc04674eb4ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d1129e4 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.014193:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b4000/0xdedcc04674eb4ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129e4 expref: 11 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.014205:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b4000/0xdedcc04674eb4ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129e4 expref: 11 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.014215:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b4000, rc 0) 00000100:00100000:1.0:1787190751.014283:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672665728:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 183us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.015206:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 132 00000100:00100000:1.0:1787190751.028657:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190751.028767:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665856 00000100:00100000:2.0:1787190751.028778:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665856 00000100:00100000:2.0:1787190751.028836:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:2.0:1787190751.028857:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672665856:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787190751.029017:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c259050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672665856:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 163us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190751.029026:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 133 00000100:00100000:0.0:1787190751.032660:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.032909:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672665984 00000100:00100000:3.0:1787190751.032920:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672665984 00000100:00100000:3.0:1787190751.032990:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:3.0:1787190751.033001:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672665984:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787190751.033166:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672665984:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 166us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.033184:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 134 00000100:00100000:0.0:1787190751.035994:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.037950:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666112 00000100:00100000:1.0:1787190751.037964:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666112 00000100:00100000:1.0:1787190751.038042:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:1.0:1787190751.038053:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666112:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787190751.038254:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666112:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 202us (2270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.038262:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 135 00000100:00100000:1.0:1787190751.055554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190751.055720:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666240 00000100:00100000:2.0:1787190751.055746:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666240 00000100:00100000:2.0:1787190751.055800:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:2.0:1787190751.055811:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666240:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787190751.056017:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666240:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 206us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190751.056025:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 136 00000100:00100000:2.0:1787190751.069453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190751.069735:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666368 00000100:00100000:0.0:1787190751.069765:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666368 00000100:00100000:0.0:1787190751.069826:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787190751.069837:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666368:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787190751.072117:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18234:x1874004672666368:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 2270us (2666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190751.072136:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 137 00000100:00100000:0.0:1787190751.090679:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.090779:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666496 00000100:00100000:1.0:1787190751.090793:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666496 00000100:00100000:1.0:1787190751.090851:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:1.0:1787190751.090863:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18228:x1874004672666496:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787190751.090884:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190751.090905:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1703b5200/0xdedcc04674eb4efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a15 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.090958:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1703b5200/0xdedcc04674eb4efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a15 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.090971:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1703b5200/0xdedcc04674eb4efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a15 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.090982:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b5200, rc 0) 00000100:00100000:1.0:1787190751.091050:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18228:x1874004672666496:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 190us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.091058:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 138 00000100:00100000:1.0:1787190751.104015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190751.104114:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666624 00000100:00100000:2.0:1787190751.104124:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666624 00000100:00100000:2.0:1787190751.104180:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:2.0:1787190751.104191:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18228:x1874004672666624:12345-192.168.202.22@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787190751.104217:0:22752:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787190751.104242:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787190751.104247:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787190751.104250:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787190751.104252:0:22752:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1787190751.104255:0:22752:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1787190751.110710:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18228:x1874004672666624:12345-192.168.202.22@tcp:256:mount.lustre.0 Request processed in 6510us (6696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.110727:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 139 00000100:00100000:0.0:1787190751.114223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.114337:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666752 00000100:00100000:3.0:1787190751.114348:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666752 00000100:00100000:3.0:1787190751.114412:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:3.0:1787190751.114422:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18228:x1874004672666752:12345-192.168.202.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787190751.114439:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190751.114454:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a1c expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190751.114493:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190751.114505:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190751.114514:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120800, rc 0) 00000100:00100000:3.0:1787190751.114574:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c258050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18228:x1874004672666752:12345-192.168.202.22@tcp:101:mount.lustre.0 Request processed in 153us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.114581:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 140 00000100:00100000:2.0:1787190751.116744:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.116848:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672666880 00000100:00100000:1.0:1787190751.116858:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672666880 00000100:00100000:1.0:1787190751.116909:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:1.0:1787190751.116918:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18228:x1874004672666880:12345-192.168.202.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787190751.117057:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18228:x1874004672666880:12345-192.168.202.22@tcp:501:mount.lustre.0 Request processed in 139us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.117065:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 141 00000100:00100000:2.0:1787190751.118924:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.121020:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667008 00000100:00100000:1.0:1787190751.121034:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667008 00000100:00100000:1.0:1787190751.121155:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:1.0:1787190751.121166:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18228:x1874004672667008:12345-192.168.202.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787190751.121400:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c25a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18228:x1874004672667008:12345-192.168.202.22@tcp:503:mount.lustre.0 Request processed in 206us (2455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.121409:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 142 00000100:00100000:2.0:1787190751.127126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.127257:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667136 00000100:00100000:3.0:1787190751.127268:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667136 00000100:00100000:3.0:1787190751.127586:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:3.0:1787190751.127598:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18239:x1874004672667136:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190751.127765:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18239:x1874004672667136:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 169us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.127772:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 143 00000100:00100000:0.0:1787190751.142855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.143325:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667264 00000100:00100000:3.0:1787190751.143337:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667264 00000100:00100000:3.0:1787190751.143396:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 144 00000100:00100000:3.0:1787190751.143406:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18239:x1874004672667264:12345-192.168.202.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787190751.143567:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18239:x1874004672667264:12345-192.168.202.22@tcp:502:llog_process_th.0 Request processed in 161us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.143576:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 144 00000100:00100000:3.0:1787190751.151310:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.151401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190751.151569:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667392 00000100:00100000:0.0:1787190751.151579:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667392 00000100:00100000:0.0:1787190751.151615:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667648 00000100:00100000:0.0:1787190751.151617:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667648 00000100:00100000:0.0:1787190751.151631:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787190751.151639:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2417:x1874004672667392:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787190751.151670:0:24032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f88c9d17-193a-4950-a347-b37a2d40d3d0@192.168.202.22@tcp t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:0.0:1787190751.151729:0:24032:0:(genops.c:1385:class_connect()) connect: client f88c9d17-193a-4950-a347-b37a2d40d3d0, cookie 0xdedcc04674eb4f0a 00000004:00100000:0.0:1787190751.151756:0:24032:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787190751.151837:0:24032:0:(import.c:65:import_set_state_nolock()) ffff99f15e4bc000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190751.151897:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143907b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2417:x1874004672667392:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 257us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190751.151904:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787190751.151920:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:0.0:1787190751.151924:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2417:x1874004672667648:12345-192.168.202.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787190751.151938:0:24032:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f88c9d17-193a-4950-a347-b37a2d40d3d0@192.168.202.22@tcp t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:0.0:1787190751.151959:0:24032:0:(genops.c:1385:class_connect()) connect: client f88c9d17-193a-4950-a347-b37a2d40d3d0, cookie 0xdedcc04674eb4f11 00000004:00100000:0.0:1787190751.151974:0:24032:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787190751.152011:0:24032:0:(import.c:65:import_set_state_nolock()) ffff99f15e4bd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190751.152030:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2417:x1874004672667648:12345-192.168.202.22@tcp:38:mount.lustre.0 Request processed in 105us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190751.152037:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:0.0:1787190751.161079:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190751.161126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190751.161163:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.161263:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667520 00000100:00100000:3.0:1787190751.161275:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667520 00000100:00100000:3.0:1787190751.161389:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667776 00000100:00100000:3.0:1787190751.161393:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667776 00000100:00100000:3.0:1787190751.161409:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672667904 00000100:00100000:3.0:1787190751.161412:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672667904 00000100:00100000:3.0:1787190751.161429:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787190751.161440:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+7:0:x1874004672667520:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787190751.161472:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787190751.161539:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+7:0:x1874004672667520:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 101us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.161545:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787190751.161562:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787190751.161568:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:0:x1874004672667776:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787190751.161580:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190751.161610:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:0:x1874004672667776:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.161635:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787190751.161648:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:3.0:1787190751.161655:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672667904:12345-192.168.202.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787190751.161664:0:22758:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787190751.161686:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672667904:12345-192.168.202.22@tcp:41:mount.lustre.0 Request processed in 32us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.161692:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00080000:0.0:1787190751.162111:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190751.162117:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190751.167900:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190751.167993:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668032 00000100:00100000:3.0:1787190751.168003:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668032 00000100:00100000:3.0:1787190751.168064:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787190751.168074:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668032:12345-192.168.202.22@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787190751.168219:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668032:12345-192.168.202.22@tcp:40:mount.lustre.0 Request processed in 146us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190751.168227:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:3.0:1787190751.178509:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.178617:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668160 00000100:00100000:1.0:1787190751.178629:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668160 00000100:00100000:1.0:1787190751.178679:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:1.0:1787190751.178688:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2417:x1874004672668160:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787190751.178729:0:25160:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f88c9d17-193a-4950-a347-b37a2d40d3d0@192.168.202.22@tcp t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:1.0:1787190751.178764:0:25160:0:(genops.c:1385:class_connect()) connect: client f88c9d17-193a-4950-a347-b37a2d40d3d0, cookie 0xdedcc04674eb4f18 00002000:00100000:1.0:1787190751.178778:0:25160:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f88c9d17-193a-4950-a347-b37a2d40d3d0/ffff99f17dea1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787190751.178790:0:25160:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787190751.178853:0:25160:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787190751.178883:0:25160:0:(import.c:65:import_set_state_nolock()) ffff99f17dea5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787190751.178952:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2417:x1874004672668160:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 263us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.178960:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787190751.181255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190751.181343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190751.181570:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668288 00000100:00100000:0.0:1787190751.181579:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668288 00000100:00100000:0.0:1787190751.181623:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:0.0:1787190751.181632:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2417:x1874004672668288:12345-192.168.202.22@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787190751.181665:0:24264:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f88c9d17-193a-4950-a347-b37a2d40d3d0@192.168.202.22@tcp t0 exp 0000000000000000 cur 728 last 0 00000020:00000080:0.0:1787190751.181698:0:24264:0:(genops.c:1385:class_connect()) connect: client f88c9d17-193a-4950-a347-b37a2d40d3d0, cookie 0xdedcc04674eb4f1f 00002000:00100000:0.0:1787190751.181709:0:24264:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f88c9d17-193a-4950-a347-b37a2d40d3d0/ffff99f15e4bf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787190751.181720:0:24264:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787190751.181783:0:24264:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787190751.181812:0:24264:0:(import.c:65:import_set_state_nolock()) ffff99f15e4b8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787190751.181884:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2417:x1874004672668288:12345-192.168.202.22@tcp:8:mount.lustre.0 Request processed in 251us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190751.181892:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:1.0:1787190751.181965:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668416 00000100:00100000:1.0:1787190751.181970:0:22769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668416 00000100:00100000:1.0:1787190751.182010:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:1.0:1787190751.182018:0:22769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668416:12345-192.168.202.22@tcp:900:mount.lustre.0 00000100:00100000:1.0:1787190751.182051:0:22769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668416:12345-192.168.202.22@tcp:900:mount.lustre.0 Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.182057:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:0.0:1787190751.189999:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190751.193881:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668544 00000100:00100000:2.0:1787190751.193898:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668544 00000100:00100000:2.0:1787190751.193977:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787190751.193987:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668544:12345-192.168.202.22@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787190751.194072:0:22762:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1787190751.194190:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18228:x1874004672668544:12345-192.168.202.22@tcp:33:mount.lustre.0 Request processed in 204us (4201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190751.194198:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787190751.377143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190751.379653:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668672 00000100:00100000:1.0:1787190751.379685:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668672 00000100:00100000:1.0:1787190751.379819:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:1.0:1787190751.379832:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18262:x1874004672668672:12345-192.168.202.22@tcp:101:mkdir.0 00010000:00010000:1.0:1787190751.379853:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190751.381442:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5e00/0xdedcc04674eb4f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a4d expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381514:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381528:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381544:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190751.381590:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1787190751.381594:0:24032:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787190751.381614:0:24032:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381643:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b5e00/0xdedcc04674eb4f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 8 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381665:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 7 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190751.381674:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:1.0:1787190751.381677:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787190751.381681:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1703b4a00, rc 0) 00000100:00100000:1.0:1787190751.381769:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+7:18262:x1874004672668672:12345-192.168.202.22@tcp:101:mkdir.0 Request processed in 1940us (4636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190751.381778:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00000040:00080000:2.0:1787190751.827012:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787190752.018736:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190753.042527:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190754.071634:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787190754.195335:0:25639:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787190754.967618:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f88c9d17-193a-4950-a347-b37a2d40d3d0 00000001:00100000:3.0:1787190754.967633:0:22739:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0dd54dd8-130e-44a0-a5c2-68ac863166bc 00000001:00100000:3.0:1787190754.967651:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f88c9d17-193a-4950-a347-b37a2d40d3d0 00000001:00100000:3.0:1787190754.967657:0:24260:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0dd54dd8-130e-44a0-a5c2-68ac863166bc 00000001:00100000:0.0:1787190754.967995:0:23491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f88c9d17-193a-4950-a347-b37a2d40d3d0 00000001:00100000:0.0:1787190754.968003:0:23491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0dd54dd8-130e-44a0-a5c2-68ac863166bc 00000001:00100000:3.0:1787190754.969886:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f88c9d17-193a-4950-a347-b37a2d40d3d0 00000001:00100000:3.0:1787190754.969898:0:25079:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0dd54dd8-130e-44a0-a5c2-68ac863166bc 00010000:00010000:3.0:1787190755.090896:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190755.475668:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787190755.475703:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695847808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1787190755.475781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190755.475853:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847808 00000100:00100000:1.0:1787190755.475860:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847808 00000100:00100000:1.0:1787190755.475915:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190755.475925:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695847808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787190755.475953:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787190755.475997:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1874004695847808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190755.476004:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787190755.476051:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3653:1874004695847808:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1787190755.476356:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787190755.986499:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787190755.986522:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695847936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190755.986578:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787190755.986587:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695848192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1787190755.986594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190755.986728:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695847936 00000100:00100000:1.0:1787190755.986735:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695847936 00000100:00100000:1.0:1787190755.986783:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787190755.986795:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695847936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787190755.986822:0:25554:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787190755.988922:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.989189:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695848576:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.989225:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.989369:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695849088:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.989399:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.989416:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695849600:0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.989516:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848192 00000100:00100000:3.0:1787190755.989523:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848192 00000100:00100000:3.0:1787190755.989566:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848576 00000100:00100000:3.0:1787190755.989569:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848576 00000100:00100000:3.0:1787190755.989582:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787190755.989591:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874004695848192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1787190755.989625:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1787190755.989665:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1874004695848192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.989671:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787190755.989687:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787190755.989693:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695848576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.989721:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695848576:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.989727:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787190755.990103:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695848064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787190755.990135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190755.990159:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695848704:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.990180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190755.990199:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695849216:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.990220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190755.990237:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695849728:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.990262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190755.990309:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849088 00000100:00100000:2.0:1787190755.990314:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849088 00000100:00100000:0.0:1787190755.992171:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.992269:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695848192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190755.993096:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695848576:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.993170:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849728 00000100:00100000:0.0:1787190755.993176:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849728 00000100:00100000:0.0:1787190755.993225:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849600 00000100:00100000:0.0:1787190755.993229:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849600 00000100:00100000:0.0:1787190755.993261:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787190755.993270:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695849728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.993412:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848064 00000100:00100000:3.0:1787190755.993418:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848064 00000100:00100000:3.0:1787190755.993508:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787190755.993515:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695848064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190755.993534:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787190755.993605:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695848064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (3468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.993611:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787190755.993709:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1874004695849728:12345-0@lo:400:kworker.0 Request processed in 440us (3446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.993715:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787190755.993729:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787190755.993735:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695849600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.993783:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695849600:12345-0@lo:400:kworker.0 Request processed in 48us (1621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.993789:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787190755.993832:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787190755.993836:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190755.993838:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190755.993840:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190755.993854:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695848448:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.993886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.993912:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695848960:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.993932:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.993946:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695849472:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.993966:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190755.994069:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848448 00000100:00100000:3.0:1787190755.994074:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848448 00000100:00100000:3.0:1787190755.994100:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787190755.994107:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3654:x1874004695848448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.994146:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3654:x1874004695848448:12345-0@lo:400:kworker.0 Request processed in 40us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.994152:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787190755.994181:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848960 00000100:00100000:3.0:1787190755.994184:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848960 00000100:00100000:3.0:1787190755.994204:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787190755.994210:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695848960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.994238:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695848960:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.994243:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787190755.995142:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695849984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190755.995208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.995249:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:edc48c39-e017-41df-adf6-48a4a7c3ab24:3654:1874004695848448:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.995260:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695848960:0@lo:400:kworker.0 00010000:00080000:3.0:1787190755.995369:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f143906300 x1874004695849600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787190755.995382:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695849600:0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.995411:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849984 00000100:00100000:3.0:1787190755.995416:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849984 00000100:00100000:3.0:1787190755.995518:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787190755.995526:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695849984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1787190755.995554:0:22763:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1787190755.995591:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695849984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190755.995597:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787190755.995664:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1787190755.995674:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695848320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1787190755.995701:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.995718:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695848832:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.995737:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848704 00000100:00100000:0.0:1787190755.995739:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190755.995741:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848704 00000100:00100000:0.0:1787190755.995749:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695849344:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.995761:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849216 00000100:00100000:2.0:1787190755.995764:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849216 00000100:00100000:0.0:1787190755.995768:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.995787:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695849856:0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.995788:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787190755.995794:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695849088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.995805:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190755.995827:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695849984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1787190755.995831:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695849088:12345-0@lo:400:kworker.0 Request processed in 38us (6432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190755.995846:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787190755.995855:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849472 00000100:00100000:0.0:1787190755.995858:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849472 00000100:00100000:2.0:1787190755.995859:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787190755.995864:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695848704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.995876:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848832 00000100:00100000:0.0:1787190755.995879:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848832 00000100:00100000:0.0:1787190755.995888:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849344 00000100:00100000:0.0:1787190755.995890:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849344 00000100:00100000:2.0:1787190755.995892:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695848704:12345-0@lo:400:kworker.0 Request processed in 28us (5712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190755.995897:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787190755.995899:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695849856 00000100:00100000:0.0:1787190755.995901:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695849856 00000100:00100000:2.0:1787190755.995907:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787190755.995912:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695849216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.995913:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787190755.995918:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695849472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.995936:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695849216:12345-0@lo:400:kworker.0 Request processed in 25us (5715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190755.995942:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787190755.995944:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3654:x1874004695849472:12345-0@lo:400:kworker.0 Request processed in 26us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.995949:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787190755.995959:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787190755.995963:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787190755.995964:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695848832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190755.995968:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695849344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787190755.996068:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695848320 00000100:00100000:3.0:1787190755.996071:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695848320 00000100:00100000:3.0:1787190755.996095:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787190755.996101:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695848320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787190755.996113:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1787190755.996163:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3654:x1874004695848832:12345-0@lo:400:kworker.0 Request processed in 198us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.996169:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787190755.996181:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787190755.996187:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695849856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.996214:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3654:x1874004695849856:12345-0@lo:400:kworker.0 Request processed in 27us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.996219:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787190755.996242:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3654:1874004695848832:0@lo:400:kworker.0 00010000:00080000:0.0:1787190755.996259:0:3654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f143905f80 x1874004695849856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787190755.996268:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3654:1874004695849856:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.996310:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3654:1874004695849472:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.996405:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695848704:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.996416:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695849216:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.996427:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3652:1874004695849728:0@lo:400:kworker.0 00000100:00100000:0.0:1787190755.997078:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695848064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190755.997226:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695847936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10434us (10630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190755.997236:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787190755.997281:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695847936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190755.998616:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695849088:0@lo:400:kworker.0 00000100:00080000:0.0:1787190755.998647:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190755.998653:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787190755.998658:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787190756.003571:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695848320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787190756.003650:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695848320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7547us (7945us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.003661:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787190756.007020:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3654:x1874004695849344:12345-0@lo:400:kworker.0 Request processed in 11042us (11241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190756.007036:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787190756.007893:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3654:1874004695849344:0@lo:400:kworker.0 00010000:00010000:0.0:1787190756.115540:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787190756.425281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425353:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425385:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425406:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425432:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425475:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425524:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190756.425554:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668928 00000100:00100000:3.0:1787190756.425565:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668928 00000100:00100000:3.0:1787190756.425617:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669440 00000100:00100000:3.0:1787190756.425621:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669440 00000100:00100000:3.0:1787190756.425633:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669056 00000100:00100000:3.0:1787190756.425635:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669056 00000100:00100000:3.0:1787190756.425648:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669568 00000100:00100000:3.0:1787190756.425651:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669568 00000100:00100000:3.0:1787190756.425666:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:3.0:1787190756.425676:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2418:x1874004672668928:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.425746:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2418:x1874004672668928:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 72us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.425753:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:3.0:1787190756.425770:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787190756.425777:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2418:x1874004672669440:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.425801:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2418:x1874004672669440:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.425816:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:3.0:1787190756.425829:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:3.0:1787190756.425834:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669056:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.425858:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669056:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.425864:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:3.0:1787190756.425874:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787190756.425994:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669568:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426039:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669568:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 159us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426046:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:3.0:1787190756.426068:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672668800 00000100:00100000:3.0:1787190756.426072:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672668800 00000100:00100000:3.0:1787190756.426097:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:3.0:1787190756.426104:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:2418:x1874004672668800:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426127:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:2418:x1874004672668800:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426133:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 146 00000100:00100000:3.0:1787190756.426163:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669184 00000100:00100000:3.0:1787190756.426167:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669184 00000100:00100000:3.0:1787190756.426191:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669696 00000100:00100000:3.0:1787190756.426194:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669696 00000100:00100000:3.0:1787190756.426205:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669312 00000100:00100000:3.0:1787190756.426207:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669312 00000100:00100000:3.0:1787190756.426216:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669824 00000100:00100000:3.0:1787190756.426225:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669824 00000100:00100000:3.0:1787190756.426244:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787190756.426250:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669184:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426430:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669184:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 179us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426438:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787190756.426451:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787190756.426458:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669696:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426482:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669696:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 25us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426488:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787190756.426498:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787190756.426505:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669312:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426528:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672669312:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 23us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426534:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787190756.426545:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:3.0:1787190756.426551:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669824:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:3.0:1787190756.426569:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2418:x1874004672669824:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 19us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190756.426574:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00080000:0.0:1787190756.427156:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787190756.427161:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787190756.427164:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1787190756.427173:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190757.138638:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787190757.427150:0:25787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6b7f6260 20000000:00000080:3.0:1787190757.427169:0:25787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99f16674a000 uarg=0000000000000000 20000000:01000000:3.0:1787190757.427212:0:25787:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787190757.427218:0:25787:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787190757.427223:0:25787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787190757.427869:0:25788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1787190757.428031:0:25787:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787190757.435406:0:25787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787190757.435844:0:25787:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435863:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435871:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435878:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435897:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435906:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435914:0:25787:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435921:0:25787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435967:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.435983:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 12 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.435998:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850112:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787190757.436197:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.436206:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.436214:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c768e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850240:192.168.202.22@tcp:104: 00010000:00010000:2.0:1787190757.436247:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.436277:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.436328:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c76b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850368:0@lo:104: 00000100:00100000:2.0:1787190757.436371:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190757.436407:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.436415:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.436520:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695850368 00000100:00100000:1.0:1787190757.436527:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695850368 00000100:00100000:1.0:1787190757.436582:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190757.436592:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695850368:12345-0@lo:104: 00010000:00010000:1.0:1787190757.436606:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436666:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190757.436673:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695850368:12345-0@lo:104: Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.436679:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1787190757.436700:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787190757.436706:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436713:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1703b4600 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:1.0:1787190757.436717:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436724:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787190757.436731:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787190757.436737:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787190757.436763:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436771:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787190757.436791:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436798:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f1703b4600/0xdedcc04674eb4c71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4c78 expref: -99 pid: 25078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.436819:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190757.436821:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787190757.436823:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190757.436843:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695850624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190757.436872:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190757.436910:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695850624 00000100:00100000:1.0:1787190757.436914:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695850624 00010000:00010000:1.0:1787190757.436931:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 24 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.436952:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190757.436959:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3651:x1874004695850624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.436970:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.436975:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 24 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.437141:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c768380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850496:0@lo:104: 00000100:00100000:2.0:1787190757.437166:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190757.437216:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695850496 00000100:00100000:0.0:1787190757.437220:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695850496 00000100:00100000:0.0:1787190757.437243:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787190757.437250:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695850496:12345-0@lo:104: 00010000:00010000:0.0:1787190757.437268:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.437335:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787190757.437341:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695850496:12345-0@lo:104: Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190757.437347:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787190757.439170:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787190757.439180:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190757.439190:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039ec00 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:3.0:1787190757.439194:0:22748:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190757.439204:0:22748:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787190757.439212:0:22748:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190757.439218:0:22748:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787190757.439269:0:22748:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190757.439276:0:22748:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787190757.439329:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190757.439337:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039ec00/0xdedcc04674eb4bd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4bde expref: -99 pid: 24259 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190757.439350:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190757.439360:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787190757.439362:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190757.439587:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695850752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190757.439636:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787190757.439781:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 24 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.439803:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.439849:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3651:x1874004695850624:12345-0@lo:103:ldlm_bl.0 Request processed in 2890us (2975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.439858:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787190757.439881:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695850752 00000100:00100000:1.0:1787190757.439887:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695850752 00010000:00010000:1.0:1787190757.439908:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 24 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.439947:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190757.439954:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3652:x1874004695850752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.439965:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.439970:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 24 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.439977:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 24 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.439986:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.440012:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3652:x1874004695850752:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.440019:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787190757.440055:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143904380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:edc48c39-e017-41df-adf6-48a4a7c3ab24:3652:1874004695850752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190757.440151:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:edc48c39-e017-41df-adf6-48a4a7c3ab24:3651:1874004695850624:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787190757.440519:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.440531:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.440542:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c769180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850880:0@lo:104: 00000100:00100000:2.0:1787190757.440571:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787190757.440648:0:25787:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 23 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.440657:0:25787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.440665:0:25787:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c769c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695851008:0@lo:104: 00000100:00100000:2.0:1787190757.440695:0:25787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190757.441022:0:25787:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16669d480 going to sleep for 11 seconds 00010000:00010000:2.0:1787190757.441040:0:25787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039f000/0xdedcc04674eb4c78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4c71 expref: 23 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.441052:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850368:0@lo:104: 00010000:00010000:2.0:1787190757.443166:0:25787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb4bde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4bd7 expref: 22 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.443186:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c768380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850496:0@lo:104: 00000100:00100000:0.0:1787190757.443816:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695850880 00000100:00100000:0.0:1787190757.443825:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695850880 00000100:00100000:0.0:1787190757.443934:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851008 00000100:00100000:0.0:1787190757.443938:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851008 00000100:00100000:0.0:1787190757.443955:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787190757.443964:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:25787:x1874004695850880:12345-0@lo:104: 00010000:00010000:0.0:1787190757.443981:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190757.444358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190757.444392:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190757.444480:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c76b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850112:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787190757.444490:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c768e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850240:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787190757.444638:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672669952 00000100:00100000:1.0:1787190757.444643:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672669952 00010000:00010000:1.0:1787190757.444664:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 13 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.444691:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670080 00000100:00100000:1.0:1787190757.444694:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670080 00010000:00010000:1.0:1787190757.444705:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 14 pid: 22752 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.444729:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787190757.444737:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08bd72b5-145e-4690-95a2-5b26cc20c570+14:2420:x1874004672669952:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.444747:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.444762:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 14 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444773:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 14 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444792:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f158120800/0xdedcc04674eb4f03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a1c expref: 14 pid: 22751 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444805:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.444852:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:2420:x1874004672669952:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 116us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.444871:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:1.0:1787190757.444889:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 12 00000100:00100000:1.0:1787190757.444895:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08bd72b5-145e-4690-95a2-5b26cc20c570+12:2420:x1874004672670080:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.444902:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.444907:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444916:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444925:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a6600/0xdedcc04674eb4ec4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129ac expref: 12 pid: 22752 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.444934:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.444952:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143904a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08bd72b5-145e-4690-95a2-5b26cc20c570+11:2420:x1874004672670080:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 57us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.444959:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 12 00010000:00010000:1.0:1787190757.448065:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787190757.448083:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+4:25787:x1874004695850880:12345-0@lo:104: Request processed in 4116us (7506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.448096:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787190757.448133:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787190757.448145:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695851008:12345-0@lo:104: 00010000:00010000:1.0:1787190757.448162:0:22743:0:(ldlm_lockd.c:2522:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.448220:0:22743:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787190757.448226:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:edc48c39-e017-41df-adf6-48a4a7c3ab24+3:25787:x1874004695851008:12345-0@lo:104: Request processed in 87us (7530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.448232:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1787190757.448416:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787190757.448435:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448459:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17039e400 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190757.448463:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448472:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190757.448479:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190757.448484:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787190757.448526:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448533:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190757.448557:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448564:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f17039e400/0xdedcc04674eb4b98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b9f expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448577:0:22747:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190757.448581:0:22747:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448586:0:22747:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f154d11800 already unused, calling callback (ffffffffc14e9c20) 10000000:00010000:0.0:1787190757.448590:0:22747:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448606:0:22747:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787190757.448611:0:22747:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190757.448616:0:22747:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787190757.448631:0:22747:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448636:0:22747:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787190757.448643:0:22747:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448650:0:22747:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.122@tcp lock: ffff99f154d11800/0xdedcc04674eb4b8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdedcc04674eb4b91 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190757.448662:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190757.448664:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190757.448666:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787190757.448681:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695851136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190757.448724:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190757.448759:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787190757.448764:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695851264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787190757.448784:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190757.449002:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851136 00000100:00100000:1.0:1787190757.449009:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851136 00010000:00010000:1.0:1787190757.449034:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 22 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.449055:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851264 00000100:00100000:1.0:1787190757.449069:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851264 00010000:00010000:1.0:1787190757.449080:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190757.449098:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190757.449104:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:3653:x1874004695851136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.449114:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.449119:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449140:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 23 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449156:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.449185:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166691850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:3653:x1874004695851136:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.449191:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787190757.449228:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787190757.449234:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:3653:x1874004695851264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787190757.449241:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190757.449245:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 22 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449253:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 22 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449275:0:22746:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449303:0:22746:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449327:0:22746:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449334:0:22746:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449341:0:22746:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449354:0:22746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449360:0:22746:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7000 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190757.449363:0:22746:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449370:0:22746:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449378:0:22746:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190757.449386:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190757.449409:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e02300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:3653:x1874004695851264:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190757.449604:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787190757.449644:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695851264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787190757.449651:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15e4e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695851136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787190757.449732:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787190757.449888:0:25787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f154d10800/0xdedcc04674eb4b9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b98 expref: 21 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.449900:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c769180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695850880:0@lo:104: 00010000:00010000:2.0:1787190757.449911:0:25787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f17039ea00/0xdedcc04674eb4b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdedcc04674eb4b8a expref: 20 pid: 22753 timeout: 834 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190757.449918:0:25787:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c769c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25787:1874004695851008:0@lo:104: 00010000:00010000:2.0:1787190757.449944:0:25787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.449953:0:25787:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.449959:0:25787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190757.449977:0:25787:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99f1700a7000/0xdedcc04674eb4f34 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.163264:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787190758.419988:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787190758.859557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190758.859896:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670208 00000100:00100000:0.0:1787190758.859908:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670208 00000100:00100000:0.0:1787190758.859986:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:0.0:1787190758.859997:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+11:18111:x1874004672670208:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190758.860015:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190758.860344:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667ba200/0xdedcc04674eb4f3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a54 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.860379:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667ba200/0xdedcc04674eb4f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a54 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.860392:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667ba200/0xdedcc04674eb4f3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a54 expref: 12 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.860401:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667ba200, rc 0) 00000100:00100000:0.0:1787190758.861749:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670208:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 1744us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190758.861761:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 147 00000100:00100000:1.0:1787190758.875002:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190758.880891:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670336 00000100:00100000:3.0:1787190758.880908:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670336 00000100:00100000:3.0:1787190758.880988:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:3.0:1787190758.881000:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670336:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190758.882848:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670336:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 1837us (7843us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190758.882861:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 148 00000100:00100000:1.0:1787190758.901048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190758.901151:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670464 00000100:00100000:0.0:1787190758.901164:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670464 00000100:00100000:0.0:1787190758.901220:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:0.0:1787190758.901229:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670464:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190758.901598:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670464:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 369us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190758.901606:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 149 00000100:00100000:2.0:1787190758.907349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190758.909622:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670592 00000100:00100000:3.0:1787190758.909637:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670592 00000100:00100000:0.0:1787190758.911673:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:0.0:1787190758.911689:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+12:18111:x1874004672670592:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190758.911710:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190758.911755:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bbc00/0xdedcc04674eb4f42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a5b expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.911791:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bbc00/0xdedcc04674eb4f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a5b expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.911804:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bbc00/0xdedcc04674eb4f42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a5b expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190758.911815:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bbc00, rc 0) 00000100:00100000:0.0:1787190758.911905:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18111:x1874004672670592:12345-192.168.202.22@tcp:101:ll_cfg_requeue.0 Request processed in 220us (4568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190758.911912:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 150 00000100:00100000:3.0:1787190758.914712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190758.915017:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670720 00000100:00100000:1.0:1787190758.915028:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670720 00000100:00100000:1.0:1787190758.915086:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:1.0:1787190758.915097:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18111:x1874004672670720:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190758.915251:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18111:x1874004672670720:12345-192.168.202.22@tcp:501:ll_cfg_requeue.0 Request processed in 142us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190758.915274:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 151 00000100:00100000:1.0:1787190758.917467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190758.918409:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670848 00000100:00100000:3.0:1787190758.918420:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670848 00000100:00100000:3.0:1787190758.918482:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:3.0:1787190758.918493:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18111:x1874004672670848:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190758.918638:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08bd72b5-145e-4690-95a2-5b26cc20c570+13:18111:x1874004672670848:12345-192.168.202.22@tcp:503:ll_cfg_requeue.0 Request processed in 146us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190758.918646:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 152 00000100:00100000:2.0:1787190759.054845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.054980:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672670976 00000100:00100000:3.0:1787190759.054991:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672670976 00000100:00100000:3.0:1787190759.055077:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:3.0:1787190759.055089:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:18731:x1874004672670976:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190759.055125:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.055150:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4f49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a62 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055222:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055253:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055268:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055284:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055345:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055353:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055427:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121a00/0xdedcc04674eb4f5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055436:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121a00/0xdedcc04674eb4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055443:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121a00/0xdedcc04674eb4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.055472:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.055482:0:24032:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.055523:0:24032:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121a00/0xdedcc04674eb4f5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055535:0:24032:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055541:0:24032:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055548:0:24032:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055554:0:24032:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120200 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.055559:0:24032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055566:0:24032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055578:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190759.055581:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.055586:0:24032:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055592:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055605:0:24032:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055612:0:24032:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055628:0:24032:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055633:0:24032:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121600 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.055635:0:24032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055642:0:24032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055650:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99f1582efe00) 00010000:00010000:3.0:1787190759.055652:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.055655:0:24032:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055660:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055691:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4f49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a62 expref: 8 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055703:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121a00/0xdedcc04674eb4f5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a62 expref: 7 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.055710:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99f1582efa00) 00010000:00010000:3.0:1787190759.055712:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190759.055715:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121a00, rc 0) 00000100:00100000:3.0:1787190759.055774:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18731:x1874004672670976:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 687us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.055790:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00080000:0.0:1787190759.056577:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787190759.062384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.062536:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671104 00000100:00100000:1.0:1787190759.062547:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671104 00000100:00100000:1.0:1787190759.062608:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:1.0:1787190759.062619:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18731:x1874004672671104:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787190759.062702:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18731:x1874004672671104:12345-192.168.202.22@tcp:900:lhsmtool_posix.0 Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.062709:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:2.0:1787190759.065763:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.065859:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671360 00000100:00100000:1.0:1787190759.065869:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671360 00000100:00100000:1.0:1787190759.065927:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:1.0:1787190759.065938:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18731:x1874004672671360:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787190759.065958:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190759.065978:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68a00/0xdedcc04674eb4f65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a69 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066054:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066068:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066080:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066095:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066117:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066123:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066229:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69400/0xdedcc04674eb4f7a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066238:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69400/0xdedcc04674eb4f7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066245:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69400/0xdedcc04674eb4f7a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190759.066267:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1787190759.066450:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066458:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066464:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066470:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce68c00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190759.066474:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066481:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066500:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99f1582efa00) 00010000:00010000:1.0:1787190759.066503:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190759.066507:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066514:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4f6c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066526:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066531:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066537:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066542:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69600 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190759.066545:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066551:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066557:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99f1664a5100) 00010000:00010000:1.0:1787190759.066559:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190759.066561:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.066566:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69600/0xdedcc04674eb4f73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.067496:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68a00/0xdedcc04674eb4f65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a69 expref: 10 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.067515:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69400/0xdedcc04674eb4f7a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a69 expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.067523:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99f1664a5400) 00010000:00010000:1.0:1787190759.067526:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190759.067528:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce69400, rc 0) 00000100:00100000:1.0:1787190759.067628:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18731:x1874004672671360:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 1692us (1875us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1787190759.067637:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787190759.075079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.078484:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671488 00000100:00100000:3.0:1787190759.078504:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671488 00000100:00100000:3.0:1787190759.078615:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:3.0:1787190759.078626:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18731:x1874004672671488:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787190759.078744:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18731:x1874004672671488:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 121us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.078751:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:0.0:1787190759.090012:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190759.090111:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671616 00000100:00100000:2.0:1787190759.090122:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671616 00000100:00100000:2.0:1787190759.090194:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787190759.090205:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:18731:x1874004672671616:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1787190759.090627:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1787190759.091353:0:22758:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1090us 00000100:00100000:0.0:1787190759.125522:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:18731:x1874004672671616:12345-192.168.202.22@tcp:59:lhsmtool_posix.0 Request processed in 35310us (35512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.125536:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:1.0:1787190759.147019:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.147093:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671744 00000100:00100000:3.0:1787190759.147104:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671744 00000100:00100000:3.0:1787190759.147167:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787190759.147179:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18737:x1874004672671744:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787190759.147202:0:22759:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.147223:0:22759:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a70 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147341:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147357:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147371:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147386:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147411:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147418:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147459:0:22759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147479:0:22759:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147487:0:22759:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147494:0:22759:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121600 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.147499:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147507:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147520:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190759.147523:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.147528:0:22759:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147534:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4f8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147546:0:22759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147558:0:22759:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147564:0:22759:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147569:0:22759:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120200 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.147572:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147577:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147585:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:3.0:1787190759.147587:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.147590:0:22759:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147596:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4f96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147626:0:22759:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4f88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a70 expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147636:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190759.147638:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.147642:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a70 expref: 10 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.147662:0:22759:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121000, rc 0) 00000100:00100000:3.0:1787190759.147717:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18737:x1874004672671744:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 541us (711us total) trans 0 rc 301/301 00000100:00100000:3.0:1787190759.147724:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 27 00000100:00100000:3.0:1787190759.153718:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.155254:0:22767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672671872 00000100:00100000:1.0:1787190759.155266:0:22767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672671872 00000100:00100000:1.0:1787190759.155347:0:22767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:3.0:1787190759.155355:0:22768:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:1.0:1787190759.155358:0:22767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18737:x1874004672671872:12345-192.168.202.22@tcp:700:lfs.0 00000100:00100000:3.0:1787190759.155365:0:22768:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000100:00100000:1.0:1787190759.155464:0:22767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18737:x1874004672671872:12345-192.168.202.22@tcp:700:lfs.0 Request processed in 107us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.155471:0:22767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:1.0:1787190759.157757:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190759.157835:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672128 00000100:00100000:2.0:1787190759.157846:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672128 00000100:00100000:2.0:1787190759.157906:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 28 00000100:00100000:2.0:1787190759.157915:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:18737:x1874004672672128:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:2.0:1787190759.157967:0:22760:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787190759.157992:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb4eee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d1129dd expref: 9 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.158010:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:2.0:1787190759.158015:0:22760:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190759.158071:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.158084:0:22760:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 5 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.158093:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.158137:0:22760:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 5 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.158150:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 5 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190759.158164:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695851392:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787190759.158240:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16669d780 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.160214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.160352:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695851392:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787190759.160379:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.160854:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672256 00000100:00100000:3.0:1787190759.160872:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672256 00010000:00010000:3.0:1787190759.160916:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 6 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.160962:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:3.0:1787190759.160972:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2420:x1874004672672256:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190759.160986:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190759.160993:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 6 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.161005:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 6 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.161027:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1703b4a00/0xdedcc04674eb4f2d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a4d expref: 6 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.161043:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190759.161048:0:22746:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.161063:0:22746:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.161071:0:22746:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787190759.162409:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787190759.162614:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190759.162690:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2420:x1874004672672256:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 1715us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.162702:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00010000:00010000:2.0:1787190759.165633:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.165651:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.168121:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.168142:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.168154:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171680:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171701:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171712:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190759.171728:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000226ca906 reply state 0000000082db98a5 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171751:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171758:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.171761:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787190759.171765:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787190759.171771:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1787190759.171779:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171785:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171793:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171799:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7c00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.171804:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171811:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171821:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f14879f500) 00010000:00010000:3.0:1787190759.171823:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.171826:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171831:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1700a7c00/0xdedcc04674eb4f9d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190759.171871:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000226ca906 reply state 0000000082db98a5 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171880:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.171886:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:3.0:1787190759.171888:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787190759.171892:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1787190759.172003:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+10:18737:x1874004672672128:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 14083us (14247us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1787190759.172012:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 28 00010000:00010000:3.0:1787190759.194792:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190759.278854:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.278954:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672384 00000100:00100000:3.0:1787190759.278967:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672384 00000100:00100000:3.0:1787190759.279031:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:3.0:1787190759.279043:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+10:18745:x1874004672672384:12345-192.168.202.22@tcp:101:lctl.0 00010000:00010000:3.0:1787190759.279069:0:22759:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.279093:0:22759:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a77 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279179:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121200/0xdedcc04674eb4fb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279195:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121200/0xdedcc04674eb4fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279208:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121200/0xdedcc04674eb4fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.279267:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.279272:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.279382:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121200/0xdedcc04674eb4fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279409:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a77 expref: 12 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279594:0:22759:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121200/0xdedcc04674eb4fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a77 expref: 11 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.279603:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:3.0:1787190759.279606:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190759.279610:0:22759:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121200, rc 0) 00000100:00100000:3.0:1787190759.279664:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+11:18745:x1874004672672384:12345-192.168.202.22@tcp:101:lctl.0 Request processed in 625us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.279671:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 29 00000100:00100000:2.0:1787190759.305355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.305496:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672512 00000100:00100000:3.0:1787190759.305509:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672512 00000100:00100000:3.0:1787190759.305584:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:3.0:1787190759.305595:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:18746:x1874004672672512:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787190759.305617:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.305647:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a7e expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305718:0:22758:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120e00/0xdedcc04674eb4fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305750:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120e00/0xdedcc04674eb4fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305763:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120e00/0xdedcc04674eb4fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.305807:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.305811:0:22758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.305831:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120e00/0xdedcc04674eb4fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305859:0:22758:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a7e expref: 7 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305877:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120e00/0xdedcc04674eb4fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a7e expref: 6 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.305886:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:3.0:1787190759.305889:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190759.305892:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120e00, rc 0) 00000100:00100000:3.0:1787190759.306105:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c76b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18746:x1874004672672512:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 511us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.306113:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 30 00000100:00100000:0.0:1787190759.315656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.315841:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672640 00000100:00100000:3.0:1787190759.315852:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672640 00000100:00100000:3.0:1787190759.315914:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:3.0:1787190759.315925:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:18746:x1874004672672640:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787190759.315945:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.315975:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a85 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316056:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316070:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316081:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316090:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316097:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316103:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316164:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316171:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316178:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.316209:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.316212:0:24032:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.316229:0:24032:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316247:0:24032:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316253:0:24032:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316260:0:24032:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316266:0:24032:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120400 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.316270:0:24032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316277:0:24032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316325:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:3.0:1787190759.316329:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.316333:0:24032:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316339:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb4fd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316351:0:24032:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316357:0:24032:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316363:0:24032:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316372:0:24032:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120000 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.316375:0:24032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316382:0:24032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316389:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:3.0:1787190759.316391:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.316394:0:24032:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316399:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb4fdc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316422:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a85 expref: 8 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316434:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a85 expref: 7 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.316442:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.316444:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190759.316447:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121400, rc 0) 00000100:00100000:3.0:1787190759.316506:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+7:18746:x1874004672672640:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 583us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.316513:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 31 00000100:00100000:2.0:1787190759.324420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.324661:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672672768 00000100:00100000:1.0:1787190759.324684:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672672768 00000100:00080000:2.0:1787190759.324757:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1787190759.329196:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:1.0:1787190759.329223:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:18746:x1874004672672768:12345-192.168.202.22@tcp:900:lfs.0 00000100:00100000:1.0:1787190759.329361:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:18746:x1874004672672768:12345-192.168.202.22@tcp:900:lfs.0 Request processed in 151us (4951us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.329369:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:2.0:1787190759.334090:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.334177:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672673024 00000100:00100000:1.0:1787190759.334187:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672673024 00000100:00100000:1.0:1787190759.334246:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:1.0:1787190759.334256:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17d99ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+7:18746:x1874004672673024:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787190759.334276:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190759.334347:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a8c expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190759.334453:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787190759.334556:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fea lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a8c expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.334571:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:1.0:1787190759.334573:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190759.334579:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a8c expref: 9 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.334592:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce68c00, rc 0) 00000100:00100000:1.0:1787190759.334702:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17d99ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+8:18746:x1874004672673024:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 446us (620us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1787190759.334723:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 32 00000100:00100000:0.0:1787190759.348504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.348594:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672673280 00000100:00100000:3.0:1787190759.348617:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672673280 00000100:00100000:3.0:1787190759.348670:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:3.0:1787190759.348680:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+8:18746:x1874004672673280:12345-192.168.202.22@tcp:36:lfs.0 00010000:00010000:3.0:1787190759.348733:0:24032:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190759.348758:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb4fe3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a85 expref: 8 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.348791:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.348796:0:24032:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190759.348816:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.348830:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.348854:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190759.349064:0:24032:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006fad526a reply state 00000000b5497ad4 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.349077:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.349083:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.349086:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1787190759.349088:0:24032:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787190759.349095:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1787190759.349161:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+9:18746:x1874004672673280:12345-192.168.202.22@tcp:36:lfs.0 Request processed in 482us (665us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1787190759.349167:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 33 00000100:00100000:2.0:1787190759.356716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.356789:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672673536 00000100:00100000:3.0:1787190759.356799:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672673536 00000100:00100000:3.0:1787190759.356853:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:3.0:1787190759.356865:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+9:18746:x1874004672673536:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787190759.357086:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+10:18746:x1874004672673536:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 223us (380us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1787190759.357093:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:2.0:1787190759.361145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.361241:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672673792 00000100:00100000:1.0:1787190759.361252:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672673792 00000100:00100000:1.0:1787190759.361348:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:1.0:1787190759.361361:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+10:18746:x1874004672673792:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787190759.361388:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190759.361406:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a93 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361480:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361494:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361506:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361516:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361523:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361530:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190759.361659:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1787190759.361737:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361773:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361781:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361787:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69800 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190759.361791:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361806:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361819:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:1.0:1787190759.361822:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190759.361827:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361833:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb5006 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361845:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361851:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361857:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361863:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce68400 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190759.361871:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361877:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361885:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:1.0:1787190759.361887:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190759.361890:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361895:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68400/0xdedcc04674eb500d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361927:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a93 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361937:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:1.0:1787190759.361939:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787190759.361942:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68c00/0xdedcc04674eb4fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a93 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.361952:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce68c00, rc 0) 00000100:00100000:1.0:1787190759.362015:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+11:18746:x1874004672673792:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 657us (880us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1787190759.362022:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 34 00000100:00100000:0.0:1787190759.365853:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.365914:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672673920 00000100:00100000:3.0:1787190759.365925:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672673920 00000100:00100000:3.0:1787190759.365980:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:3.0:1787190759.365991:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+11:18746:x1874004672673920:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:3.0:1787190759.366017:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.366036:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb501b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112a9a expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366121:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366135:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366146:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.366171:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.366175:0:24032:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.366193:0:24032:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366232:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121400/0xdedcc04674eb501b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 13 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366275:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 12 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.366329:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.366897:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787190759.366902:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120000, rc 0) 00000100:00100000:2.0:1787190759.367238:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f88c9d17-193a-4950-a347-b37a2d40d3d0+12:18746:x1874004672673920:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1246us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190759.367256:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 35 00000100:00100000:2.0:1787190759.372091:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.372178:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674048 00000100:00100000:3.0:1787190759.372188:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674048 00000100:00100000:3.0:1787190759.372719:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:3.0:1787190759.372730:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+12:18746:x1874004672674048:12345-192.168.202.22@tcp:37:lfs.0 00000100:00100000:3.0:1787190759.378155:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+12:18746:x1874004672674048:12345-192.168.202.22@tcp:37:lfs.0 Request processed in 5414us (6062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.378169:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 3 00000100:00100000:0.0:1787190759.382150:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 10000000:01000000:1.0:1787190759.382382:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787190759.382387:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f1587ec800 from 13 10000000:01000000:1.0:1787190759.382392:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787190759.382435:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.382461:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.382473:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.382499:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787190759.382550:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190759.382602:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.384768:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851520 00000100:00100000:0.0:1787190759.384796:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851520 00000100:00100000:0.0:1787190759.384859:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787190759.384868:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+20:22756:x1874004695851520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190759.384884:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190759.384898:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667ba600/0xdedcc04674eb5030 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb5029 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.384934:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667ba600/0xdedcc04674eb5030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb5029 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.384944:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667ba600/0xdedcc04674eb5030 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb5029 expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.384954:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667ba600, rc 0) 00000100:00100000:0.0:1787190759.385016:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170302850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.385023:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787190759.385077:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190759.385094:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb5030 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.385103:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb5030 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190759.385180:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.385209:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190759.385234:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165ecaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.385249:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851648 00000100:00100000:0.0:1787190759.385258:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851648 00000100:00100000:0.0:1787190759.385277:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787190759.385282:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.385418:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.385425:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787190759.385448:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.385470:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.385502:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190759.385517:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165ecaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.385527:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851776 00000100:00100000:0.0:1787190759.385529:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851776 00000100:00100000:0.0:1787190759.385546:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787190759.385551:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.385622:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170300050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.385628:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787190759.385659:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.387876:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674304 00000100:00100000:2.0:1787190759.387910:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674304 00000100:00100000:2.0:1787190759.388005:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 4 00000100:00100000:2.0:1787190759.388015:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c424450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+12:18746:x1874004672674304:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:2.0:1787190759.388313:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c424450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+13:18746:x1874004672674304:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 299us (6175us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1787190759.388320:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 4 00000040:00080000:0.0:1787190759.389190:0:25802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787190759.389265:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787190759.389307:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190759.389320:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb5030 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.389332:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f17ce68400/0xdedcc04674eb5029 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb5030 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190759.389357:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190759.389360:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f17c59d800 from 13 10000000:01000000:0.0:1787190759.389363:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190759.389394:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.389402:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.389412:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190759.389433:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.389479:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190759.389508:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165eca000 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.389525:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695851904 00000100:00100000:0.0:1787190759.389531:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695851904 00000100:00100000:0.0:1787190759.389564:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787190759.389571:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+21:22756:x1874004695851904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787190759.395154:0:22753:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190759.395179:0:22753:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb503e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb5037 expref: -99 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.395214:0:22753:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb503e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb5037 expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.395226:0:22753:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1667bb600/0xdedcc04674eb503e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb5037 expref: 22 pid: 22753 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.395254:0:22753:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bb600, rc 0) 00000100:00100000:0.0:1787190759.395373:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f170303450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695851904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5801us (5893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.395382:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787190759.397183:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695851904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190759.397210:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb503e expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.397222:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb503e expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190759.397348:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ce9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.397395:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190759.397428:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16669d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.398686:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852032 00000100:00100000:0.0:1787190759.398699:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852032 00000100:00100000:0.0:1787190759.398766:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787190759.398775:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695852032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.399072:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f142be4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695852032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.399080:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787190759.399185:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ce9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.399225:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17ce9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.399274:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787190759.399349:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16669d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.399549:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852160 00000100:00100000:0.0:1787190759.399554:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852160 00000100:00100000:0.0:1787190759.399592:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787190759.399599:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695852160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.399684:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695852160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.399690:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787190759.399880:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17ce9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787190759.425861:0:25803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1787190759.426094:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1787190759.426115:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787190759.426126:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb503e expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.426138:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667ba000/0xdedcc04674eb5037 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb503e expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787190759.426149:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787190759.426151:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f144dc0000 from 13 10000000:01000000:3.0:1787190759.426154:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787190759.426185:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.426204:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.426216:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.426239:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787190759.426334:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190759.426370:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.426442:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852288 00000100:00100000:2.0:1787190759.426450:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852288 00000100:00100000:2.0:1787190759.426499:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787190759.426516:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+22:22756:x1874004695852288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190759.426530:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190759.426541:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1700a7600/0xdedcc04674eb504c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb5045 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.426566:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1700a7600/0xdedcc04674eb504c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb5045 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.426588:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1700a7600/0xdedcc04674eb504c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb5045 expref: 23 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.426596:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1700a7600, rc 0) 00000100:00100000:2.0:1787190759.426634:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190759.426640:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787190759.426864:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787190759.426880:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb504c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.426889:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb504c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.426947:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190759.426974:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190759.426998:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.427162:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852416 00000100:00100000:2.0:1787190759.427167:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852416 00000100:00100000:2.0:1787190759.427199:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787190759.427205:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.427349:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190759.427355:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787190759.427959:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787190759.427996:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787190759.428043:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190759.428074:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378840 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.428393:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852544 00000100:00100000:2.0:1787190759.428399:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852544 00000100:00100000:2.0:1787190759.428433:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787190759.428441:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787190759.428542:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190759.428556:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787190759.428696:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787190759.434985:0:25804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1787190759.435619:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787190759.435648:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190759.435660:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb504c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.435674:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f158121400/0xdedcc04674eb5045 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb504c expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787190759.435707:0:22756:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787190759.435710:0:22756:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99f15e512000 from 13 10000000:01000000:0.0:1787190759.435712:0:22756:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787190759.435749:0:22756:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.435758:0:22756:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.435769:0:22756:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190759.435793:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.435872:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190759.435920:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165eca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.436212:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852672 00000100:00100000:2.0:1787190759.436222:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852672 00000100:00100000:2.0:1787190759.436282:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787190759.436324:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+23:22756:x1874004695852672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787190759.436338:0:22751:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787190759.436349:0:22751:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99f1700a6c00/0xdedcc04674eb505a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdedcc04674eb5053 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.436374:0:22751:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99f1700a6c00/0xdedcc04674eb505a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdedcc04674eb5053 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.436385:0:22751:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99f1700a6c00/0xdedcc04674eb505a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdedcc04674eb5053 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190759.436394:0:22751:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1700a6c00, rc 0) 00000100:00100000:2.0:1787190759.436439:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f146a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695852672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190759.436445:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787190759.436737:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787190759.436752:0:22756:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb505a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.436760:0:22756:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdedcc04674eb505a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.436817:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190759.437134:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190759.437170:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.437216:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852800 00000100:00100000:0.0:1787190759.437223:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852800 00000100:00100000:0.0:1787190759.437260:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787190759.437267:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695852800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.437407:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695852800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.437414:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787190759.438443:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787190759.438936:0:22756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787190759.439008:0:22756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190759.439046:0:22756:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190759.439072:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695852928 00000100:00100000:0.0:1787190759.439079:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695852928 00000100:00100000:0.0:1787190759.439125:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787190759.439221:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695852928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787190759.439357:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:22756:x1874004695852928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190759.439371:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787190759.439801:0:22756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f15ffa8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:edc48c39-e017-41df-adf6-48a4a7c3ab24:22756:1874004695852928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787190759.441952:0:25805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000040:00080000:1.0:1787190759.444333:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:0.0:1787190759.444857:0:22756:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1787190759.444886:0:22756:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787190759.444899:0:22756:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb505a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.444911:0:22756:0:(ldlm_lock.c:924:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.122@tcp lock: ffff99f1667bb200/0xdedcc04674eb5053 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdedcc04674eb505a expref: -99 pid: 22756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.459082:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.459241:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674432 00000100:00100000:3.0:1787190759.459273:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674432 00000100:00100000:3.0:1787190759.459821:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:3.0:1787190759.459834:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+11:18752:x1874004672674432:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:3.0:1787190759.459856:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.459887:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112aa1 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.459951:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.459968:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.459980:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.459989:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.459996:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460002:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460075:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb5076 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460084:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb5076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460092:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb5076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.460138:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787190759.460142:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190759.460183:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb5076 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460210:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460217:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460223:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460229:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121800 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.460232:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460246:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460259:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:3.0:1787190759.460261:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.460266:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460272:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb5068 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460323:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460339:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460345:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460350:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121e00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.460353:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460358:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460375:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:3.0:1787190759.460377:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.460381:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460386:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb506f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460414:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa1 expref: 13 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460426:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121c00/0xdedcc04674eb5076 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa1 expref: 12 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.460432:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.460434:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787190759.460444:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121c00, rc 0) 00000100:00100000:3.0:1787190759.460543:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+12:18752:x1874004672674432:12345-192.168.202.22@tcp:101:bash.0 Request processed in 712us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.460552:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 36 00000100:00100000:2.0:1787190759.466527:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.466604:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674560 00000100:00100000:1.0:1787190759.466618:0:22770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674560 00000100:00100000:1.0:1787190759.466677:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787190759.466689:0:22770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:18752:x1874004672674560:12345-192.168.202.22@tcp:900:bash.0 00000100:00100000:1.0:1787190759.466786:0:22770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:18752:x1874004672674560:12345-192.168.202.22@tcp:900:bash.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.466794:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787190759.479580:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.479768:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674816 00000100:00100000:3.0:1787190759.479779:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674816 00000100:00100000:3.0:1787190759.479843:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:3.0:1787190759.479854:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+12:18752:x1874004672674816:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:3.0:1787190759.479886:0:22759:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190759.479907:0:22759:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb507d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112aa8 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.480017:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.480035:0:22759:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 12 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.480044:0:22759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.480078:0:22759:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 12 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.480092:0:22759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 12 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.480107:0:22759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1874004695853056:192.168.202.22@tcp:104: 00000100:00100000:3.0:1787190759.480212:0:22759:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378180 going to sleep for 11 seconds 00000100:00100000:2.0:1787190759.489627:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.490096:0:22759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22759:1874004695853056:192.168.202.22@tcp:104: 00010000:00010000:3.0:1787190759.490137:0:22759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.490485:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672674944 00000100:00100000:1.0:1787190759.490494:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672674944 00010000:00010000:1.0:1787190759.490547:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 13 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.490589:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:1.0:1787190759.490599:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+13:2420:x1874004672674944:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787190759.490618:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190759.490626:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 13 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490639:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 13 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490664:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120000/0xdedcc04674eb5022 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112a9a expref: 13 pid: 24032 timeout: 836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490701:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:1.0:1787190759.490707:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490717:0:22744:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490725:0:22744:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.490756:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787190759.490820:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f88c9d17-193a-4950-a347-b37a2d40d3d0+12:2420:x1874004672674944:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 222us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.490828:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00010000:00010000:3.0:1787190759.491487:0:22759:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.491496:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.491529:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.491541:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.491549:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492062:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492074:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492081:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190759.492093:0:22759:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787190759.492119:0:22759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492138:0:22759:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492145:0:22759:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492151:0:22759:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121e00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:3.0:1787190759.492156:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492164:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492176:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:3.0:1787190759.492179:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787190759.492183:0:22759:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492190:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5084 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787190759.492203:0:22759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c239df99 reply state 000000002e93fd0d transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492214:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.492221:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99f1582efd00) 00010000:00010000:3.0:1787190759.492223:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787190759.492226:0:22759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787190759.493010:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb507d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 15 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.493045:0:22759:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 14 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.493053:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190759.493056:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787190759.493058:0:22759:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120800, rc 0) 00000100:00100000:3.0:1787190759.493138:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+15:18752:x1874004672674816:12345-192.168.202.22@tcp:101:bash.0 Request processed in 13285us (13568us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1787190759.493147:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 37 00000100:00100000:2.0:1787190759.511796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190759.512053:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672675072 00000100:00100000:0.0:1787190759.512064:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672675072 00000100:00100000:0.0:1787190759.512131:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:0.0:1787190759.512142:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+15:18752:x1874004672675072:12345-192.168.202.22@tcp:101:bash.0 00010000:00010000:0.0:1787190759.512170:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190759.512207:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50a0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112aaf expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.512282:0:22758:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.512353:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.512367:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190759.512433:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787190759.512437:0:22758:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787190759.512504:0:22758:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.512517:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.512543:0:22758:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50a0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.512563:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.512572:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190759.512575:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190759.512591:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667ba800, rc 0) 00000100:00100000:1.0:1787190759.512655:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+16:18752:x1874004672675072:12345-192.168.202.22@tcp:101:bash.0 Request processed in 514us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.512662:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 38 00000100:00100000:2.0:1787190759.529224:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.529409:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672675328 00000100:00100000:3.0:1787190759.529422:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672675328 00000100:00100000:3.0:1787190759.529487:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 5 00000100:00100000:3.0:1787190759.529499:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+16:18752:x1874004672675328:12345-192.168.202.22@tcp:35:bash.0 00000001:00080000:3.0:1787190759.529754:0:22761:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901897 00000100:00100000:3.0:1787190759.529881:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+18:18752:x1874004672675328:12345-192.168.202.22@tcp:35:bash.0 Request processed in 383us (664us total) trans 12884901898 rc 0/0 00000100:00100000:3.0:1787190759.529889:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 5 00000020:00080000:3.0:1787190759.529895:0:22761:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787190759.679929:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190759.682875:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672675584 00000100:00100000:0.0:1787190759.682908:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672675584 00000100:00100000:0.0:1787190759.685143:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:0.0:1787190759.685168:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+18:18762:x1874004672675584:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:0.0:1787190759.685209:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190759.685232:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ab6 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190759.686490:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1787190759.686623:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ab6 expref: 20 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.686640:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99f1582ef100) 00010000:00010000:0.0:1787190759.686643:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190759.686648:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ab6 expref: 20 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190759.686663:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f1667bae00, rc 0) 00000100:00100000:0.0:1787190759.686741:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+19:18762:x1874004672675584:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 1586us (6822us total) trans 12884901899 rc 301/301 00000100:00100000:0.0:1787190759.686750:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 39 00000100:00100000:1.0:1787190759.696159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.696592:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672675840 00000100:00100000:3.0:1787190759.696603:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672675840 00000100:00100000:3.0:1787190759.696672:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:3.0:1787190759.696684:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15ffa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+19:18762:x1874004672675840:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:3.0:1787190759.696908:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15ffa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18762:x1874004672675840:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 226us (759us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1787190759.696916:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 6 00000100:00100000:2.0:1787190759.736197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190759.736345:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676096 00000100:00100000:1.0:1787190759.736357:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676096 00000100:00100000:1.0:1787190759.736510:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:1.0:1787190759.736523:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18765:x1874004672676096:12345-192.168.202.22@tcp:101:lfs.0 00010000:00010000:1.0:1787190759.736550:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190759.736568:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb50bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112abd expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.736787:0:22758:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69e00/0xdedcc04674eb50c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.736804:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69e00/0xdedcc04674eb50c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.736816:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69e00/0xdedcc04674eb50c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190759.736829:0:22758:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787190759.736936:0:22758:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb50bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112abd expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.736955:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69e00/0xdedcc04674eb50c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112abd expref: 22 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.736963:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190759.736980:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787190759.736985:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce69e00, rc 0) 00000100:00100000:1.0:1787190759.737052:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18765:x1874004672676096:12345-192.168.202.22@tcp:101:lfs.0 Request processed in 532us (862us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1787190759.737059:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 40 00000100:00100000:2.0:1787190759.741235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190759.742408:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190759.742536:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676352 00000100:00100000:3.0:1787190759.742546:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676352 00000100:00100000:3.0:1787190759.742612:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:3.0:1787190759.742624:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18765:x1874004672676352:12345-192.168.202.22@tcp:54:lfs.0 00010000:00010000:3.0:1787190759.742699:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.742704:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676224 00000100:00100000:1.0:1787190759.742708:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676224 00010000:00010000:3.0:1787190759.742715:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.742735:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.742775:0:22759:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.742783:0:22759:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.742785:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00010000:00010000:3.0:1787190759.742791:0:22759:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190759.742793:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+23:2420:x1874004672676224:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190759.742799:0:22759:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120400 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190759.742803:0:25097:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190759.742804:0:22759:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.742811:0:22759:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.742822:0:25097:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69e00/0xdedcc04674eb50c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112abd expref: 23 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190759.743006:0:25097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190759.743011:0:25097:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787190759.743021:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190759.743024:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787190759.743060:0:22759:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190759.743067:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190759.743111:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18765:x1874004672676352:12345-192.168.202.22@tcp:54:lfs.0 Request processed in 490us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190759.743111:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:2420:x1874004672676224:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 318us (1885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190759.743119:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 41 00000100:00100000:1.0:1787190759.743119:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:2.0:1787190759.746817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190759.747336:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676608 00000100:00100000:0.0:1787190759.747347:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676608 00000100:00100000:1.0:1787190759.747449:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 7 00000100:00100000:1.0:1787190759.747459:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+21:18765:x1874004672676608:12345-192.168.202.22@tcp:35:lfs.0 00000100:00100000:1.0:1787190759.747718:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18765:x1874004672676608:12345-192.168.202.22@tcp:35:lfs.0 Request processed in 259us (910us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1787190759.747726:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 7 00000040:00080000:2.0:1787190760.018888:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787190760.102689:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.102792:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676864 00000100:00100000:3.0:1787190760.102801:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676864 00000100:00100000:3.0:1787190760.102985:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:3.0:1787190760.102997:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18796:x1874004672676864:12345-192.168.202.22@tcp:101:cat.0 00010000:00010000:3.0:1787190760.103021:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190760.103041:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ac4 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.103169:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb50df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.103185:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb50df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.103199:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb50df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190760.103210:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787190760.103536:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb50d8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ac4 expref: 25 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.103559:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb50df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ac4 expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.103583:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.103586:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190760.103590:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158121e00, rc 0) 00000100:00100000:3.0:1787190760.103710:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:18796:x1874004672676864:12345-192.168.202.22@tcp:101:cat.0 Request processed in 714us (1027us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1787190760.103717:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 42 00000100:00100000:2.0:1787190760.110326:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.110929:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672676992 00000100:00100000:3.0:1787190760.110940:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672676992 00000100:00100000:3.0:1787190760.111011:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:3.0:1787190760.111023:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:2421:x1874004672676992:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.111041:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.111069:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb50df lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ac4 expref: 24 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.111093:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.111098:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190760.111168:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+23:2421:x1874004672676992:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 147us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.111176:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787190760.116247:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.116660:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672677248 00000100:00100000:1.0:1787190760.116672:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672677248 00000100:00100000:1.0:1787190760.116731:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:1.0:1787190760.116756:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+23:18796:x1874004672677248:12345-192.168.202.22@tcp:35:cat.0 00000100:00100000:1.0:1787190760.117212:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:18796:x1874004672677248:12345-192.168.202.22@tcp:35:cat.0 Request processed in 456us (981us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1787190760.117221:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 8 00000100:00100000:2.0:1787190760.198252:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.198690:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672677504 00000100:00100000:0.0:1787190760.198702:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672677504 00000100:00100000:0.0:1787190760.198766:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 43 00000100:00100000:0.0:1787190760.198777:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:18802:x1874004672677504:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:0.0:1787190760.198811:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.198833:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50ed lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112acb expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.198987:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199003:0:24032:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199011:0:24032:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 25 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199020:0:24032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199056:0:24032:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 25 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199070:0:24032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 25 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.199086:0:24032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24032:1874004695853184:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787190760.199181:0:24032:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.199189:0:24032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.199199:0:24032:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24032:1874004695853312:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787190760.199231:0:24032:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165ecaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787190760.203651:0:24032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24032:1874004695853184:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787190760.203673:0:24032:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e02a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24032:1874004695853312:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787190760.203701:0:24032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190760.205466:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.205562:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672677632 00000100:00100000:3.0:1787190760.205573:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672677632 00010000:00010000:3.0:1787190760.205623:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 26 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.205670:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:3.0:1787190760.205694:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+26:2420:x1874004672677632:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.205710:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.205716:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 26 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.205729:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 26 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.205751:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667ba800/0xdedcc04674eb50a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aaf expref: 26 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.205769:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.205773:0:22746:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.205782:0:22746:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.205800:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190760.205859:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+25:2420:x1874004672677632:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 167us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.205866:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 17 00000100:00100000:2.0:1787190760.208222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.208525:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672677760 00000100:00100000:3.0:1787190760.208535:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672677760 00010000:00010000:3.0:1787190760.208573:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.208604:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:3.0:1787190760.208627:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f166693450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+25:2421:x1874004672677760:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.208639:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.208645:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208659:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208677:0:22744:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb5092 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aa8 expref: 25 pid: 22759 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208695:0:22744:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.208700:0:22744:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208708:0:22744:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208715:0:22744:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.208750:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787190760.208888:0:24032:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.208897:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787190760.208917:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787190760.209072:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f1667bae00/0xdedcc04674eb50ed lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112acb expref: 26 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.209088:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56ec00/0xdedcc04674eb50f4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112acb expref: 25 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.209095:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:2.0:1787190760.209098:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787190760.209101:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56ec00, rc 0) 00000100:00100000:3.0:1787190760.209143:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f166693450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+25:2421:x1874004672677760:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 517us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.209152:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 18 00000100:00100000:2.0:1787190760.210104:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:18802:x1874004672677504:12345-192.168.202.22@tcp:101:dd.0 Request processed in 11324us (11869us total) trans 12884901905 rc 0/0 00000100:00100000:2.0:1787190760.210113:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 43 00010000:00010000:0.0:1787190760.210568:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787190760.213715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.213930:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672677888 00000100:00100000:1.0:1787190760.213940:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672677888 00000100:00100000:1.0:1787190760.214028:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:1.0:1787190760.214039:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+24:18802:x1874004672677888:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:1.0:1787190760.214063:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190760.214080:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5102 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ad2 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214115:0:22758:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214128:0:22758:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214140:0:22758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22758 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214266:0:22758:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5102 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 26 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214445:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 25 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.214456:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.214465:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787190760.214470:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce68600, rc 0) 00000100:00100000:1.0:1787190760.214526:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+25:18802:x1874004672677888:12345-192.168.202.22@tcp:101:dd.0 Request processed in 489us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190760.214534:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 44 00000100:00100000:1.0:1787190760.217920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.218207:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678144 00000100:00100000:3.0:1787190760.218217:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678144 00000100:00100000:3.0:1787190760.218337:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 45 00000100:00100000:3.0:1787190760.218350:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+25:18802:x1874004672678144:12345-192.168.202.22@tcp:36:dd.0 00010000:00010000:3.0:1787190760.218600:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.218621:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.218634:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787190760.218678:0:22759:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901906 00000004:00010000:3.0:1787190760.218702:0:22759:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8203fcc reply state 000000008ee530b3 transno 12884901907 ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.218715:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.218723:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.218727:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787190760.218730:0:22759:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787190760.218830:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678144:12345-192.168.202.22@tcp:36:dd.0 Request processed in 483us (919us total) trans 12884901907 rc 0/0 00000100:00100000:3.0:1787190760.218838:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 45 00000020:00080000:3.0:1787190760.218843:0:22759:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787190760.222840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.223020:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678272 00000100:00100000:3.0:1787190760.223032:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678272 00000100:00100000:3.0:1787190760.223095:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:3.0:1787190760.223105:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678272:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:3.0:1787190760.223129:0:22760:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190760.223147:0:22760:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5117 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ad9 expref: -99 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.223230:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5117 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad9 expref: 29 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.223256:0:22760:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5117 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad9 expref: 29 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.223277:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.223280:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787190760.223284:0:22760:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120400, rc 0) 00000100:00100000:3.0:1787190760.223671:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18802:x1874004672678272:12345-192.168.202.22@tcp:101:dd.0 Request processed in 564us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.223678:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 46 00000100:00100000:1.0:1787190760.235814:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.235952:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678528 00000100:00100000:3.0:1787190760.235963:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678528 00000100:00100000:3.0:1787190760.236034:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:3.0:1787190760.236046:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15e4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18802:x1874004672678528:12345-192.168.202.22@tcp:103:dd.0 00010000:00010000:3.0:1787190760.236062:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.236086:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5117 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad9 expref: 29 pid: 22760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.236107:0:22746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:3.0:1787190760.236112:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190760.236175:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15e4e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678528:12345-192.168.202.22@tcp:103:dd.0 Request processed in 131us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.236183:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 2 00000100:00100000:2.0:1787190760.239106:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.239228:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678656 00000100:00100000:0.0:1787190760.239247:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678656 00000100:00100000:0.0:1787190760.239351:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:0.0:1787190760.239363:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678656:12345-192.168.202.22@tcp:58:dd.0 00010000:00010000:0.0:1787190760.239488:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.239506:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.239517:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787190760.242697:0:24032:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787190760.242732:0:24032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1787190760.243593:0:24032:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1787190760.243769:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678656:12345-192.168.202.22@tcp:58:dd.0 Request processed in 4402us (4667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.243781:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 47 00000100:00100000:2.0:1787190760.246677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.246766:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678784 00000100:00100000:1.0:1787190760.246776:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678784 00000100:00100000:1.0:1787190760.246874:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 48 00000100:00100000:1.0:1787190760.246885:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+28:18802:x1874004672678784:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:1.0:1787190760.246906:0:22758:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787190760.246923:0:22758:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ae0 expref: -99 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.246975:0:22758:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.246986:0:22758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 29 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.247005:0:22758:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.247017:0:22758:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 29 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.247031:0:22758:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.247045:0:22758:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190760.247050:0:22758:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 29 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.247058:0:22758:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17ce68800, rc 0) 00000100:00100000:1.0:1787190760.247118:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18802:x1874004672678784:12345-192.168.202.22@tcp:101:dd.0 Request processed in 236us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190760.247125:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 48 00000040:00080000:1.0:1787190760.466553:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1787190760.466562:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787190760.466600:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1787190760.466611:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1787190760.466755:0:22794:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22794:1874004695853440:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787190760.466848:0:22794:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1787190760.477914:0:22794:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22794:1874004695853440:192.168.202.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787190760.481998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.483569:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672678912 00000100:00100000:3.0:1787190760.483696:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672678912 00000100:00100000:3.0:1787190760.483825:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:3.0:1787190760.483837:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18803:x1874004672678912:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787190760.483886:0:22759:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787190760.484040:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18803:x1874004672678912:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 205us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.484049:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 49 00000100:00100000:2.0:1787190760.489743:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.490156:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672679040 00000100:00100000:1.0:1787190760.490168:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672679040 00000100:00100000:1.0:1787190760.490340:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:1.0:1787190760.490702:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18803:x1874004672679040:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787190760.490773:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490789:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490801:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490832:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490839:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490846:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490866:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490883:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490891:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787190760.490933:0:22760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787190760.490937:0:22760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1787190760.490949:0:22760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490959:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490965:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490971:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490985:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce68e00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.490989:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.490996:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.491008:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99f1664a5400) 00010000:00010000:1.0:1787190760.491011:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.491027:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.492199:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68e00/0xdedcc04674eb512c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.492220:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.492227:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.493543:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.493553:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69200 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.493556:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.493565:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494535:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff99f1664a5600) 00010000:00010000:1.0:1787190760.494825:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.494833:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494840:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5133 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494870:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494876:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494882:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494886:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69000 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.494889:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494894:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494903:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.494905:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.494908:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.494914:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb513a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.496176:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18803:x1874004672679040:12345-192.168.202.22@tcp:34:lhsmtool_posix.0 Request processed in 4675us (5299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190760.496189:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 50 00000100:00100000:2.0:1787190760.501957:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.502059:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672679296 00000100:00100000:0.0:1787190760.502069:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672679296 00000100:00100000:0.0:1787190760.502126:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:0.0:1787190760.502149:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17ce9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+29:18803:x1874004672679296:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.502169:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.502187:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f800/0xdedcc04674eb5141 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112ae7 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502330:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502344:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502361:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787190760.502372:0:24032:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787190760.502441:0:24032:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502448:0:24032:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502455:0:24032:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502460:0:24032:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56fa00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:0.0:1787190760.502464:0:24032:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502470:0:24032:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502481:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:0.0:1787190760.502490:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787190760.502495:0:24032:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502501:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5148 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502542:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f800/0xdedcc04674eb5141 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae7 expref: 31 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502550:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99f1664a5400) 00010000:00010000:0.0:1787190760.502552:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787190760.502556:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f800/0xdedcc04674eb5141 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae7 expref: 31 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.502564:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56f800, rc 0) 00000100:00100000:0.0:1787190760.502642:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17ce9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+30:18803:x1874004672679296:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 494us (695us total) trans 12884901908 rc 301/301 00000100:00100000:0.0:1787190760.502649:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 51 00000100:00100000:2.0:1787190760.511615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.511960:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672679424 00000100:00100000:3.0:1787190760.511971:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672679424 00000100:00100000:3.0:1787190760.512039:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:3.0:1787190760.512052:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+30:18803:x1874004672679424:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787190760.512105:0:22758:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787190760.512225:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1483fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+30:18803:x1874004672679424:12345-192.168.202.22@tcp:53:lhsmtool_posix.0 Request processed in 175us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.512233:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 52 00000100:00100000:2.0:1787190760.520819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.520901:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672679680 00000100:00100000:0.0:1787190760.520911:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672679680 00000100:00100000:3.0:1787190760.521078:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:3.0:1787190760.521092:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+30:18803:x1874004672679680:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190760.521116:0:22759:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190760.521136:0:22759:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5156 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112aee expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787190760.521568:0:22759:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:3.0:1787190760.521585:0:22759:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:3.0:1787190760.521607:0:22759:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:3.0:1787190760.526264:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb515d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.526321:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb515d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.526332:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb515d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.526405:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5156 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aee expref: 33 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.526426:0:22759:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb515d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aee expref: 32 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.526436:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f1582ef800) 00010000:00010000:3.0:1787190760.526439:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787190760.526443:0:22759:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120800, rc 0) 00000100:00100000:3.0:1787190760.526526:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+32:18803:x1874004672679680:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 5437us (5715us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1787190760.526536:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 53 00000100:00100000:2.0:1787190760.529700:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.530053:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672679936 00000100:00100000:1.0:1787190760.530063:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672679936 00000100:00100000:1.0:1787190760.530123:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:1.0:1787190760.530135:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+32:18803:x1874004672679936:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190760.530193:0:22760:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787190760.530218:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120800/0xdedcc04674eb515d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112aee expref: 32 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530247:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f1582ef800) 00010000:00010000:1.0:1787190760.530257:0:22760:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787190760.530278:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530328:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530340:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530366:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530375:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530382:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530451:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530458:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530465:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530471:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69000 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.530476:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530484:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530492:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:1.0:1787190760.530495:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.530499:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530505:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69000/0xdedcc04674eb516b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530513:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530518:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530523:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530533:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69200 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.530537:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530543:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530550:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xaeb5cb4 (ffff99f1664a5600) 00010000:00010000:1.0:1787190760.530552:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.530555:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.530560:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5172 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xaeb5cb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.530650:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+31:18803:x1874004672679936:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 517us (960us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787190760.530657:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 54 00000100:00100000:2.0:1787190760.570511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.570731:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672680064 00000100:00100000:0.0:1787190760.570742:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672680064 00000100:00100000:0.0:1787190760.570808:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:0.0:1787190760.570820:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+31:18803:x1874004672680064:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.570844:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.570864:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f800/0xdedcc04674eb5179 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112af5 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.570908:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5180 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.570919:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5180 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.570927:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5180 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.571014:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f800/0xdedcc04674eb5179 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112af5 expref: 33 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.571039:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fa00/0xdedcc04674eb5180 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112af5 expref: 32 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.571045:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:0.0:1787190760.571047:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190760.571050:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56fa00, rc 0) 00000100:00100000:0.0:1787190760.571098:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+32:18803:x1874004672680064:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 283us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.571103:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 55 00000100:00100000:2.0:1787190760.575179:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.575498:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672680320 00000100:00100000:1.0:1787190760.575509:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672680320 00000100:00100000:1.0:1787190760.575644:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:1.0:1787190760.575654:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+32:18803:x1874004672680320:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787190760.575737:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.575755:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.575764:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787190760.575926:0:22760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1787190760.575934:0:22760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 737740645631ns, next at 738740643695ns, rc = 0 00000004:00010000:1.0:1787190760.575969:0:22760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b16cf97 reply state 00000000740ee0d0 transno 12884901910 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.575978:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.575984:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:1.0:1787190760.575986:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1787190760.575989:0:22760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787190760.576165:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+34:18803:x1874004672680320:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 511us (995us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1787190760.576172:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 56 00000100:00100000:2.0:1787190760.579461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.579743:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672680448 00000100:00100000:0.0:1787190760.579754:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672680448 00000100:00100000:0.0:1787190760.579820:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:0.0:1787190760.579832:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+34:18803:x1874004672680448:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.579857:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.579876:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112afc expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.579954:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 35 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.579968:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 35 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.579987:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:0.0:1787190760.579990:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787190760.579994:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56fe00, rc 0) 00000100:00100000:0.0:1787190760.580066:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+35:18803:x1874004672680448:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 236us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.580074:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787190760.583088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.583321:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672680576 00000100:00100000:3.0:1787190760.583332:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672680576 00000100:00100000:3.0:1787190760.583421:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:3.0:1787190760.583433:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2420:x1874004672680576:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787190760.583940:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c454380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2420:x1874004672680576:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 509us (860us total) trans 12884901891 rc 0/0 00000100:00100000:3.0:1787190760.583950:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00080000:2.0:1787190760.584020:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787190760.587178:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.588118:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672680832 00000100:00100000:3.0:1787190760.588140:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672680832 00000100:00100000:3.0:1787190760.588192:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:3.0:1787190760.588200:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+35:18803:x1874004672680832:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787190760.588546:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+36:18803:x1874004672680832:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 346us (1375us total) trans 12884901911 rc 0/0 00000100:00100000:3.0:1787190760.588554:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 9 00000100:00100000:1.0:1787190760.590879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.591013:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681088 00000100:00100000:3.0:1787190760.591020:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681088 00000100:00100000:3.0:1787190760.591111:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:3.0:1787190760.591119:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+36:18803:x1874004672681088:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190760.591211:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+36:18803:x1874004672681088:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.591216:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:0.0:1787190760.594258:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190760.594551:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787190760.594571:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695853568:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1787190760.594620:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190760.594781:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695853568 00000100:00100000:1.0:1787190760.594787:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695853568 00000100:00100000:1.0:1787190760.594834:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787190760.594841:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695853568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787190760.594864:0:25554:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1787190760.594900:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c457b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695853568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190760.594905:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787190760.594938:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f1666cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695853568:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1787190760.594984:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190760.595341:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681216 00000100:00100000:3.0:1787190760.595345:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681216 00000100:00100000:3.0:1787190760.595393:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:3.0:1787190760.595401:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+36:18803:x1874004672681216:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787190760.595415:0:22759:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787190760.595433:0:22759:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5195 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112b03 expref: -99 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595488:0:22759:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595501:0:22759:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595531:0:22759:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787190760.595713:0:22759:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787190760.595737:0:22759:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595764:0:22759:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb5195 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b03 expref: 38 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595782:0:22759:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b03 expref: 37 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.595789:0:22759:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:3.0:1787190760.595792:0:22759:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787190760.595796:0:22759:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f158120a00, rc 0) 00000100:00100000:3.0:1787190760.595905:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+37:18803:x1874004672681216:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 504us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.595912:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:2.0:1787190760.599737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.599866:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681344 00000100:00100000:0.0:1787190760.599876:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681344 00000100:00100000:0.0:1787190760.599967:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787190760.599978:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+6:2421:x1874004672681344:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.599997:0:24266:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.600017:0:24266:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112b0a expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787190760.600116:0:24266:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a865de9, blocks: 0x0 00010000:00010000:0.0:1787190760.600137:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=737s v=(0 0) 00010000:00010000:0.0:1787190760.600142:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190760.600151:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 7 pid: 24266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.600187:0:24266:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 7 pid: 24266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.600201:0:24266:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56e600, rc 0) 00000100:00100000:0.0:1787190760.600457:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2421:x1874004672681344:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 480us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.600465:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:2.0:1787190760.604176:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.604246:0:22758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681600 00000100:00100000:3.0:1787190760.604256:0:22758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681600 00000100:00100000:3.0:1787190760.604399:0:22758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:3.0:1787190760.604409:0:22758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+37:18803:x1874004672681600:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787190760.604510:0:22758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+37:18803:x1874004672681600:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.604518:0:22758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:1.0:1787190760.606280:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.606549:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681728 00000100:00100000:3.0:1787190760.606568:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681728 00000100:00100000:3.0:1787190760.606703:0:22759:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:3.0:1787190760.606710:0:22759:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f1666cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+37:18803:x1874004672681728:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1787190760.608378:0:3638:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608402:0:3638:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608411:0:3638:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608418:0:3638:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121000 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.608422:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608430:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608445:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff99f1582efe00) 00010000:00010000:1.0:1787190760.608448:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.608453:0:3638:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608460:0:3638:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121000/0xdedcc04674eb4fa4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608479:0:3638:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787190760.608482:0:22739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901911 is committed 00010000:00010000:1.0:1787190760.608485:0:3638:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608490:0:3638:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608495:0:3638:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120200 already unused, calling callback (ffffffffc1af94f0) 00000004:00080000:0.0:1787190760.608496:0:22739:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1787190760.608514:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608521:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608530:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:1.0:1787190760.608533:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.608535:0:3638:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608546:0:3638:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120200/0xdedcc04674eb4fab lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608558:0:3638:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608565:0:3638:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608570:0:3638:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608575:0:3638:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121800 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.608578:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608584:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608590:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff99f1582efd00) 00010000:00010000:1.0:1787190760.608592:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.608600:0:3638:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608606:0:3638:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121800/0xdedcc04674eb508b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608619:0:3638:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608625:0:3638:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608630:0:3638:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608635:0:3638:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121e00 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.608638:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608643:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608652:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.608654:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.608657:0:3638:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608662:0:3638:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121e00/0xdedcc04674eb5110 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22759 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.608669:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787190760.608672:0:3638:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.608685:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695853696:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1787190760.608685:0:3638:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608691:0:3638:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608695:0:3638:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69200 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.608698:0:3638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608703:0:3638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608711:0:3638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:1.0:1787190760.608712:0:3638:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787190760.608715:0:3638:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.608720:0:3638:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69200/0xdedcc04674eb5187 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.608746:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190760.608920:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695853696 00000100:00100000:1.0:1787190760.608928:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695853696 00000100:00080000:2.0:1787190760.608972:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787190760.608992:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787190760.609001:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1874004695853696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787190760.609119:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787190760.609134:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1787190760.609136:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787190760.609138:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787190761 -> 1787190761 00002000:00010000:1.0:1787190760.609146:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000001:00080000:0.0:1787190760.609156:0:22739:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1787190760.609186:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1874004695853696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (440us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1787190760.609194:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787190760.609237:0:3637:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787190760.609244:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99f143907100/2, rc 0, transno 12884901892 00010000:00010000:2.0:1787190760.609246:0:3637:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.609249:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143907100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3651:1874004695853696:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787190760.609252:0:3637:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.609257:0:3637:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158121600 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:2.0:1787190760.609266:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.609273:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.609283:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff99f1582ef900) 00010000:00010000:2.0:1787190760.609318:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787190760.609322:0:3637:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.609328:0:3637:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158121600/0xdedcc04674eb4ff8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.609694:0:22759:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f1666cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+15:18803:x1874004672681728:12345-192.168.202.22@tcp:44:lhsmtool_posix.0 Request processed in 2982us (3419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.609701:0:22759:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 61 00000100:00100000:2.0:1787190760.616972:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.617322:0:24263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672681856 00000100:00100000:3.0:1787190760.617333:0:24263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672681856 00000100:00100000:3.0:1787190760.617396:0:24263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:3.0:1787190760.617406:0:24263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2420:x1874004672681856:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787190760.617513:0:24263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2420:x1874004672681856:12345-192.168.202.22@tcp:16:lhsmtool_posix.0 Request processed in 108us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.617520:0:24263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 23 00000100:00100000:2.0:1787190760.623908:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.624003:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682112 00000100:00100000:0.0:1787190760.624014:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682112 00000100:00100000:0.0:1787190760.624079:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:0.0:1787190760.624091:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+15:18803:x1874004672682112:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.624142:0:24032:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190760.624165:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120a00/0xdedcc04674eb519c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b03 expref: 15 pid: 22759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.624185:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:0.0:1787190760.624190:0:24032:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787190760.624222:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f200/0xdedcc04674eb51aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.624248:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f200/0xdedcc04674eb51aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.624277:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f200/0xdedcc04674eb51aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787190760.624461:0:24032:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aef22f35 reply state 00000000b8e5d263 transno 12884901912 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f200/0xdedcc04674eb51aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.624473:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f200/0xdedcc04674eb51aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.624479:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:0.0:1787190760.624482:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787190760.624484:0:24032:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787190760.624583:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+16:18803:x1874004672682112:12345-192.168.202.22@tcp:36:lhsmtool_posix.0 Request processed in 493us (686us total) trans 12884901912 rc 0/0 00000100:00100000:0.0:1787190760.624590:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 62 00000100:00100000:1.0:1787190760.629565:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.629649:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682240 00000100:00100000:0.0:1787190760.629659:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682240 00000100:00100000:0.0:1787190760.629713:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:0.0:1787190760.629723:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:18803:x1874004672682240:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787190760.629742:0:24266:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.629756:0:24266:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112b11 expref: -99 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.629788:0:24266:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 8 pid: 24266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.629797:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190760.629813:0:24266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190760.629819:0:24266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.629851:0:24266:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 8 pid: 24266 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.629876:0:24266:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 8 pid: 24266 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.629890:0:24266:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24266:1874004695853824:192.168.202.22@tcp:104: 00000100:00100000:0.0:1787190760.629976:0:24266:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f165ecaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190760.642070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.642430:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682368 00000100:00100000:3.0:1787190760.642440:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682368 00010000:00010000:3.0:1787190760.642479:0:22744:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 9 pid: 24266 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.642527:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:3.0:1787190760.642538:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:2421:x1874004672682368:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.642554:0:22744:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.642575:0:22744:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 9 pid: 24266 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.642609:0:22744:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 9 pid: 24266 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.642646:0:22744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190760.642657:0:22744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787190760.642664:0:22744:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.642674:0:22744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.642713:0:22744:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.642730:0:22744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22744:1874004695853952:192.168.202.22@tcp:105: 00000100:00100000:3.0:1787190760.642829:0:22744:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16665a0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787190760.642935:0:24266:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049788aee/0xdedcc04674eb51a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b0a expref: 9 pid: 24266 timeout: 837 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.642951:0:24266:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e00a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24266:1874004695853824:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787190760.642980:0:24266:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.642991:0:24266:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56fc00, rc 0) 00000100:00100000:0.0:1787190760.643031:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+8:18803:x1874004672682240:12345-192.168.202.22@tcp:101:lhsmtool_posix.0 Request processed in 13309us (13476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.643038:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 24 00000100:00100000:3.0:1787190760.657433:0:22744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22744:1874004695853952:192.168.202.22@tcp:105: 00010000:00010000:3.0:1787190760.657460:0:22744:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190760.657557:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2421:x1874004672682368:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 15020us (15495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.657569:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 19 00000100:00100000:2.0:1787190760.660887:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.661102:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682496 00000100:00100000:1.0:1787190760.661112:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682496 00000100:00100000:1.0:1787190760.661174:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787190760.661185:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2420:x1874004672682496:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787190760.663991:0:25160:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787190760.664001:0:25160:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1787190760 00002000:00010000:1.0:1787190760.664005:0:25160:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1787190759 00002000:00010000:1.0:1787190760.664007:0:25160:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787190761 -> 1787190760 00002000:00010000:1.0:1787190760.664010:0:25160:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1787190760.664444:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0dd54dd8-130e-44a0-a5c2-68ac863166bc+8:2420:x1874004672682496:12345-192.168.202.22@tcp:2:lhsmtool_posix.0 Request processed in 3255us (3562us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1787190760.664456:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 25 00000100:00100000:1.0:1787190760.672361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:2.0:1787190760.672455:0:24811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682624 00000100:00100000:2.0:1787190760.672465:0:24811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682624 00000100:00100000:2.0:1787190760.672521:0:24811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:2.0:1787190760.672531:0:24811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+8:2418:x1874004672682624:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787190760.672575:0:24811:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.672596:0:24811:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.672605:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190760.672623:0:24811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787190760.672628:0:24811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.672665:0:24811:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 8 pid: 24266 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.672679:0:24811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 8 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190760.672694:0:24811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17c456d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24811:1874004695854080:192.168.202.22@tcp:104: 00000100:00100000:2.0:1787190760.672766:0:24811:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f16669d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787190760.676644:0:24811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17c456d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24811:1874004695854080:192.168.202.22@tcp:104: 00010000:00010000:0.0:1787190760.676673:0:24811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.684570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.686459:0:22746:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672682752 00000100:00100000:3.0:1787190760.686473:0:22746:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672682752 00010000:00010000:3.0:1787190760.686519:0:22746:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.686638:0:22746:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 20 00000100:00100000:3.0:1787190760.686650:0:22746:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:2421:x1874004672682752:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.686666:0:22746:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.686688:0:22746:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.686703:0:22746:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.686726:0:22746:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf9c369a/0xdedcc04674eb51b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b11 expref: 9 pid: 24266 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.686745:0:22746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190760.686750:0:22746:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787190760.686757:0:22746:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.686768:0:22746:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.686802:0:22746:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787190760.686873:0:22746:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+8:2421:x1874004672682752:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 225us (2312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.686881:0:22746:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 20 00010000:00010000:0.0:1787190760.687161:0:24811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687172:0:24811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687193:0:24811:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687202:0:24811:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687211:0:24811:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687219:0:24811:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7800 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190760.687224:0:24811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687234:0:24811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687246:0:24811:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.687266:0:24811:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088bb12d0/0xdedcc04674eb51b8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.687380:0:24811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c00a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2418:x1874004672682624:12345-192.168.202.22@tcp:1:lhsmtool_posix.0 Request processed in 14849us (15039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.687388:0:24811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 26 00000100:00100000:0.0:1787190760.695281:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.697891:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683008 00000100:00100000:1.0:1787190760.697908:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683008 00000100:00100000:1.0:1787190760.698036:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 63 00000100:00100000:1.0:1787190760.698049:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+16:18803:x1874004672683008:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787190760.698152:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.698191:0:22760:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.698199:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.698237:0:22760:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 16 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.698251:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 16 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.698264:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854208:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787190760.698555:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787190760.714416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.714760:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683136 00000100:00100000:0.0:1787190760.714772:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683136 00010000:00010000:0.0:1787190760.714819:0:22745:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 17 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.714867:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 21 00000100:00100000:0.0:1787190760.714878:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+17:2421:x1874004672683136:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787190760.714894:0:22745:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787190760.714900:0:22745:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 17 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.714913:0:22745:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 17 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.714935:0:22745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:0.0:1787190760.714942:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 17 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.714971:0:22745:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.714978:0:22745:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.714986:0:22745:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.715007:0:22745:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190760.715067:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c454e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+17:2421:x1874004672683136:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 191us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.715075:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 21 00010000:00010000:1.0:1787190760.716332:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68600/0xdedcc04674eb5109 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ad2 expref: 16 pid: 22758 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.716364:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854208:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787190760.716390:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716410:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716417:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716871:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716893:0:22760:0:(ldlm_lock.c:692:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 16 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716902:0:22760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716937:0:22760:0:(ldlm_lockd.c:967:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 16 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.716952:0:22760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 16 pid: 24032 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.716965:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854336:192.168.202.22@tcp:104: 00000100:00100000:1.0:1787190760.717047:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f1501f7300 going to sleep for 11 seconds 00000100:00100000:2.0:1787190760.722959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.723050:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854336:192.168.202.22@tcp:104: 00010000:00010000:1.0:1787190760.723080:0:22760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.723220:0:25097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683264 00000100:00100000:3.0:1787190760.723227:0:25097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683264 00010000:00010000:3.0:1787190760.723262:0:25097:0:(ldlm_lockd.c:2699:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 17 pid: 24032 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787190760.723337:0:25097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 22 00000100:00100000:3.0:1787190760.723346:0:25097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+17:2420:x1874004672683264:12345-192.168.202.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787190760.723360:0:25097:0:(ldlm_lockd.c:1751:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787190760.723366:0:25097:0:(ldlm_lockd.c:1803:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 17 pid: 24032 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.723387:0:25097:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 17 pid: 24032 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.723414:0:25097:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56fe00/0xdedcc04674eb518e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112afc expref: 17 pid: 24032 timeout: 837 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.723428:0:25097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:3.0:1787190760.723433:0:25097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.723443:0:25097:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.723451:0:25097:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.723556:0:25097:0:(ldlm_lockd.c:1815:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787190760.723621:0:25097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+16:2420:x1874004672683264:12345-192.168.202.22@tcp:103:ldlm_bl.0 Request processed in 274us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.723629:0:25097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 22 00010000:00010000:1.0:1787190760.723837:0:22760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.723846:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787190760.723961:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1787190760.724084:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000001:00080000:1.0:1787190760.724116:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:1.0:1787190760.724344:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22760:1874004695854464:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787190760.724501:0:22760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190760.724529:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f158378180 going to sleep for 11 seconds 00000100:00100000:3.0:1787190760.724574:0:22763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695854464 00000100:00100000:3.0:1787190760.724580:0:22763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695854464 00000100:00100000:3.0:1787190760.724623:0:22763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787190760.724630:0:22763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22760:x1874004695854464:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787190760.724700:0:22763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22760:x1874004695854464:12345-0@lo:1000:mdt00_002.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.724707:0:22763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787190760.724770:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22760:1874004695854464:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1787190760.724898:0:22760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901916 00000100:00100000:1.0:1787190760.724940:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22760:1874004695854592:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1787190760.724967:0:22760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190760.724992:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787190760.725668:0:22764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695854592 00000100:00100000:3.0:1787190760.725674:0:22764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695854592 00000100:00100000:3.0:1787190760.725710:0:22764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787190760.725717:0:22764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22760:x1874004695854592:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787190760.725845:0:22764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22760:x1874004695854592:12345-0@lo:1000:mdt00_002.0 Request processed in 128us (876us total) trans 12884901894 rc 0/0 00000100:00100000:3.0:1787190760.725852:0:22764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787190760.726113:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22760:1874004695854592:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1787190760.726220:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726231:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726246:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726252:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69800 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.726258:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726265:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726280:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:1.0:1787190760.726283:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190760.726543:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726552:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51c6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726595:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726602:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726608:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726614:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56f400 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.726617:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726622:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726631:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.726634:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787190760.726640:0:22760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726651:0:22760:0:(ldlm_lock.c:720:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726661:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.726712:0:22760:0:(ldlm_lockd.c:1086:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68800/0xdedcc04674eb5125 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112ae0 expref: 19 pid: 22758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.726737:0:22760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854720:192.168.202.22@tcp:105: 00000100:00100000:1.0:1787190760.726806:0:22760:0:(client.c:2715:ptlrpc_set_wait()) set ffff99f17c15f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787190760.740935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.741185:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683392 00000100:00100000:3.0:1787190760.741196:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683392 00000100:00100000:3.0:1787190760.741269:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:3.0:1787190760.741280:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c427850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18802:x1874004672683392:12345-192.168.202.22@tcp:49:dd.0 00000100:00100000:3.0:1787190760.741466:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c427850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18802:x1874004672683392:12345-192.168.202.22@tcp:49:dd.0 Request processed in 188us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190760.741474:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 10 00000100:00100000:1.0:1787190760.743464:0:22760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22760:1874004695854720:192.168.202.22@tcp:105: 00010000:00010000:1.0:1787190760.743497:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743508:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56f400/0xdedcc04674eb511e lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743545:0:22760:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743561:0:22760:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743573:0:22760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743582:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743588:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743595:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743601:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce69800 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.743606:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743627:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743640:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.743643:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787190760.743647:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743653:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce69800/0xdedcc04674eb51cd lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743663:0:22760:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743669:0:22760:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743696:0:22760:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743702:0:22760:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17ce68000 already unused, calling callback (ffffffffc1af94f0) 00010000:00010000:1.0:1787190760.743705:0:22760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743711:0:22760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743724:0:22760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:1.0:1787190760.743726:0:22760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787190760.743729:0:22760:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.743746:0:22760:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17ce68000/0xdedcc04674eb51bf lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.743988:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+19:18803:x1874004672683008:12345-192.168.202.22@tcp:57:lhsmtool_posix.0 Request processed in 45940us (48716us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1787190760.743999:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 63 00000020:00080000:1.0:1787190760.744007:0:22760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787190760.745528:0:22794:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1787190760.745535:0:22794:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787190760.745550:0:22794:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1787190760.745555:0:22794:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1787190760.750762:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.751984:0:24032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683520 00000100:00100000:0.0:1787190760.751998:0:24032:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683520 00000100:00100000:0.0:1787190760.752139:0:24032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:0.0:1787190760.752152:0:24032:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+19:18802:x1874004672683520:12345-192.168.202.22@tcp:101:dd.0 00010000:00010000:0.0:1787190760.752175:0:24032:0:(ldlm_lockd.c:1269:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787190760.752196:0:24032:0:(ldlm_lockd.c:1347:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e200/0xdedcc04674eb51d4 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1510e59a6d112b18 expref: -99 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752232:0:24032:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e000/0xdedcc04674eb51db lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752265:0:24032:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e000/0xdedcc04674eb51db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752275:0:24032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e000/0xdedcc04674eb51db lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24032 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752437:0:24032:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e200/0xdedcc04674eb51d4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b18 expref: 21 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752457:0:24032:0:(ldlm_lockd.c:1517:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99f17c56e000/0xdedcc04674eb51db lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.22@tcp remote: 0x1510e59a6d112b18 expref: 20 pid: 24032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.752466:0:24032:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff99f1582ef700) 00010000:00010000:0.0:1787190760.752468:0:24032:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787190760.752472:0:24032:0:(ldlm_lockd.c:1596:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99f17c56e000, rc 0) 00000100:00100000:0.0:1787190760.752532:0:24032:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18802:x1874004672683520:12345-192.168.202.22@tcp:101:dd.0 Request processed in 383us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190760.752539:0:24032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 64 00000100:00100000:2.0:1787190760.753674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:3.0:1787190760.753934:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683776 00000100:00100000:3.0:1787190760.753944:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683776 00000100:00100000:3.0:1787190760.754021:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 11 00000100:00100000:3.0:1787190760.754031:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+20:18803:x1874004672683776:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787190760.754671:0:22762:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787190760.754762:0:22762:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901918 00010000:00010000:3.0:1787190760.754790:0:22762:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754818:0:22762:0:(ldlm_lock.c:1077:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754829:0:22762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754839:0:22762:0:(ldlm_lock.c:959:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754845:0:22762:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754852:0:22762:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787190760.754912:0:22762:0:(ldlm_lockd.c:2196:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787190760.755010:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:18803:x1874004672683776:12345-192.168.202.22@tcp:35:lhsmtool_posix.0 Request processed in 978us (1338us total) trans 12884901919 rc 0/0 00000100:00100000:3.0:1787190760.755018:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 11 00000020:00080000:3.0:1787190760.755023:0:22762:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787190760.756334:0:22748:0:(ldlm_lockd.c:2817:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787190760.756347:0:22748:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.756357:0:22748:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f158120400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190760.756362:0:22748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.756372:0:22748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.756714:0:22748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff99f17c2c0600) 00010000:00010000:0.0:1787190760.756716:0:22748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787190760.756721:0:22748:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.756726:0:22748:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99f158120400/0xdedcc04674eb51e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22762 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.756740:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190760.756742:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787190760.756744:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190760.806393:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190760.806496:0:24269:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672683904 00000100:00100000:0.0:1787190760.806508:0:24269:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672683904 00000100:00100000:0.0:1787190760.806582:0:24269:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 0 00000100:00100000:0.0:1787190760.806593:0:24269:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2419:x1874004672683904:12345-192.168.202.22@tcp:4:dd.0 00002000:00010000:0.0:1787190760.806644:0:24269:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6a865de8, atime: 0x6a865de7, ctime: 0x6a865de8, blocks: 0x0 00010000:00010000:0.0:1787190760.806654:0:24269:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.806671:0:24269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=737s v=(0 0) 00010000:00010000:0.0:1787190760.806675:0:24269:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787190760.806682:0:24269:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.806698:0:24269:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787190760.813269:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190760.825192:0:24271:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787190760.825209:0:24271:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1787190760.825754:0:24271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684032 00000100:00100000:1.0:1787190760.825764:0:24271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684032 00000100:00100000:2.0:1787190760.826363:0:25806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 1 00000100:00100000:2.0:1787190760.826377:0:25806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+9:2418:x1874004672684032:12345-192.168.202.22@tcp:4:dd.0 00010000:00010000:2.0:1787190760.826421:0:25806:0:(ldlm_lock.c:780:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.826450:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190760.826454:0:25806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787190760.826461:0:25806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787190760.826476:0:25806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787190760.895896:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:2.0:1787190760.895913:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:1.0:1787190760.896461:0:24269:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1787190760.896466:0:24269:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1787190760 -> 1787190761 00002000:00010000:1.0:1787190760.896469:0:24269:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1787190760 -> 1787190761 00002000:00010000:1.0:1787190760.896471:0:24269:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1787190760.896491:0:24269:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896505:0:24269:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896514:0:24269:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896522:0:24269:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f17c56e200 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:1.0:1787190760.896528:0:24269:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896552:0:24269:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896576:0:24269:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787190760.896583:0:24269:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005770f8d8/0xdedcc04674eb51e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24269 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787190760.896740:0:24269:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0dd54dd8-130e-44a0-a5c2-68ac863166bc+7:2419:x1874004672683904:12345-192.168.202.22@tcp:4:dd.0 Request processed in 90145us (90354us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1787190760.896751:0:24269:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 0 00000001:00080000:3.0:1787190760.924192:0:25079:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1787190760.924678:0:25806:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1787190760.924696:0:25806:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1787190760.924715:0:25806:0:(ldlm_lock.c:834:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924729:0:25806:0:(ldlm_lock.c:892:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924739:0:25806:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924747:0:25806:0:(ldlm_lockd.c:1928:ldlm_handle_bl_callback()) Lock ffff99f1700a7400 already unused, calling callback (ffffffffc0ee80c0) 00010000:00010000:0.0:1787190760.924753:0:25806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924761:0:25806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924780:0:25806:0:(ldlm_lockd.c:1940:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787190760.924788:0:25806:0:(ldlm_lock.c:194:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000294678ed/0xdedcc04674eb51f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787190760.924948:0:25806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2418:x1874004672684032:12345-192.168.202.22@tcp:4:dd.0 Request processed in 98569us (111685us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1787190760.924959:0:25806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 1 00000040:00080000:2.0:1787190761.044827:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787190761.106624:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695854976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1787190761.106710:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787190761.106749:0:3654:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787190761.106755:0:3654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f175e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1787190761.106775:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.107061:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695854976 00000100:00100000:1.0:1787190761.107069:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695854976 00000100:00100000:1.0:1787190761.107131:0:23762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695854848 00000100:00100000:1.0:1787190761.107135:0:23762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695854848 00000100:00100000:1.0:1787190761.107154:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787190761.107163:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695854976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1787190761.107197:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1787190761.107246:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3654:x1874004695854976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.107254:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787190761.107271:0:23762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190761.107278:0:23762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695854848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1787190761.107326:0:23762:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:1.0:1787190761.107364:0:23762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3654:x1874004695854848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.107370:0:23762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190761.107397:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787190761.107406:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695855104:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1787190761.107432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.107627:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3654:1874004695854848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1787190761.107640:0:3654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f175e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3654:1874004695854976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787190761.107824:0:24268:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855104 00000100:00100000:3.0:1787190761.107827:0:24268:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855104 00000100:00100000:3.0:1787190761.107875:0:24268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787190761.107883:0:24268:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695855104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1787190761.107898:0:24268:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3676622848 00000100:00100000:3.0:1787190761.107930:0:24268:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1874004695855104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190761.107935:0:24268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1787190761.107979:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787190761.108006:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695855232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787190761.108033:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787190761.108064:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3652:1874004695855104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1787190761.108086:0:24267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855232 00000100:00100000:3.0:1787190761.108089:0:24267:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855232 00000100:00100000:3.0:1787190761.108114:0:24267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787190761.108120:0:24267:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f143904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695855232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787190761.108131:0:24267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1787190761.108163:0:24267:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f143904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1874004695855232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787190761.108169:0:24267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787190761.108182:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787190761.108201:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f143905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3652:1874004695855232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787190761.109118:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f166668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695855360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190761.109155:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109408:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695855616:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109438:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109454:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695856128:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109470:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109486:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787190761.109491:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695855744:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109512:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109527:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695856256:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109571:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695855872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109604:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109619:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695856384:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109649:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787190761.109654:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695855488:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109679:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109713:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695856000:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109748:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787190761.109772:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855616 00000100:00100000:1.0:1787190761.109778:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855616 00000100:00100000:1.0:1787190761.109806:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695856128 00000100:00100000:1.0:1787190761.109808:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695856128 00000100:00100000:1.0:1787190761.109824:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695856256 00000100:00100000:1.0:1787190761.109826:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695856256 00000100:00100000:1.0:1787190761.109837:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855872 00000100:00100000:1.0:1787190761.109851:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855872 00000100:00100000:1.0:1787190761.109864:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695856384 00000100:00100000:1.0:1787190761.109867:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695856384 00000100:00100000:1.0:1787190761.109879:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695856000 00000100:00100000:1.0:1787190761.109881:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695856000 00000100:00100000:1.0:1787190761.109895:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787190761.109902:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695855616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.109961:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1874004695855616:12345-0@lo:400:kworker.0 Request processed in 59us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.109968:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787190761.110001:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3651:1874004695855616:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110024:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787190761.110030:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695856128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110063:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1874004695856128:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.110069:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787190761.110092:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17cf68a80 x1874004695856128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190761.110104:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3651:1874004695856128:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110129:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787190761.110135:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695856256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110166:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1874004695856256:12345-0@lo:400:kworker.0 Request processed in 32us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.110172:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787190761.110193:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3651:1874004695856256:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110209:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787190761.110215:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695855872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110245:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1874004695855872:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.110251:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787190761.110272:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3653:1874004695855872:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110324:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787190761.110331:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695856384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110361:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1874004695856384:12345-0@lo:400:kworker.0 Request processed in 31us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.110366:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787190761.110386:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff99f17cf68380 x1874004695856384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787190777 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787190761.110395:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3653:1874004695856384:0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110410:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190761.110416:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695856000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787190761.110442:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1874004695856000:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.110454:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787190761.110479:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3653:1874004695856000:0@lo:400:kworker.0 00000100:00100000:2.0:1787190761.111216:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855488 00000100:00100000:2.0:1787190761.111224:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855488 00000100:00100000:2.0:1787190761.111270:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787190761.111278:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3653:x1874004695855488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787190761.111357:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:edc48c39-e017-41df-adf6-48a4a7c3ab24+24:3653:x1874004695855488:12345-0@lo:400:kworker.0 Request processed in 80us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.111363:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787190761.111411:0:25554:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855360 00000100:00100000:2.0:1787190761.111415:0:25554:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855360 00000100:00100000:2.0:1787190761.111435:0:25554:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787190761.111441:0:25554:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f175e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695855360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787190761.111456:0:25554:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3676622848 00000100:00100000:2.0:1787190761.111487:0:25554:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f175e00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1874004695855360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.111492:0:25554:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787190761.111530:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:edc48c39-e017-41df-adf6-48a4a7c3ab24:3653:1874004695855488:0@lo:400:kworker.0 00000100:00100000:2.0:1787190761.111542:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:2.0:1787190761.111546:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99f143907100, transno 12884901892 00000004:00080000:2.0:1787190761.111555:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:2.0:1787190761.111579:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f166668000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3653:1874004695855360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787190761.111715:0:24266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004695855744 00000100:00100000:0.0:1787190761.111720:0:24266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004695855744 00000100:00100000:0.0:1787190761.111756:0:24266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190761.111762:0:24266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17cf69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695855744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787190761.111799:0:24266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17cf69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1874004695855744:12345-0@lo:400:kworker.0 Request processed in 37us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190761.111805:0:24266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787190761.111828:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99f17cf6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3651:1874004695855744:0@lo:400:kworker.0 00000100:00080000:3.0:1787190761.112022:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190761.112027:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1787190761.235013:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787190761.544434:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.544480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.544514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.544560:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.544590:0:25160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684928 00000100:00100000:1.0:1787190761.544600:0:25160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684928 00000100:00100000:1.0:1787190761.544658:0:25160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:1.0:1787190761.544669:0:25160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672684928:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:1.0:1787190761.544736:0:25160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c15a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672684928:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787190761.544744:0:25160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 14 00000100:00100000:1.0:1787190761.544890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.544994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.545013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:1.0:1787190761.545031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.22@tcp (source: 12345-192.168.202.22@tcp) 00000100:00100000:0.0:1787190761.545132:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684160 00000100:00100000:0.0:1787190761.545138:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684160 00000100:00100000:0.0:1787190761.545176:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787190761.545184:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:2419:x1874004672684160:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787190761.545216:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f15a394c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08bd72b5-145e-4690-95a2-5b26cc20c570+13:2419:x1874004672684160:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 33us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190761.545223:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 166 00000100:00100000:0.0:1787190761.545247:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684544 00000100:00100000:0.0:1787190761.545251:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684544 00000100:00100000:0.0:1787190761.545271:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672685056 00000100:00100000:0.0:1787190761.545273:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672685056 00000100:00100000:0.0:1787190761.545347:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:0.0:1787190761.545353:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2419:x1874004672684544:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787190761.545377:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2419:x1874004672684544:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190761.545383:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 15 00000100:00100000:0.0:1787190761.545392:0:24264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:0.0:1787190761.545397:0:24264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672685056:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:0.0:1787190761.545417:0:24264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672685056:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 21us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787190761.545423:0:24264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 16 00000100:00100000:2.0:1787190761.545634:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684416 00000100:00100000:2.0:1787190761.545639:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684416 00000100:00100000:2.0:1787190761.545660:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684672 00000100:00100000:2.0:1787190761.545663:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684672 00000100:00100000:2.0:1787190761.545673:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684288 00000100:00100000:2.0:1787190761.545676:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684288 00000100:00100000:2.0:1787190761.545685:0:22760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874004672684800 00000100:00100000:2.0:1787190761.545687:0:22760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874004672684800 00000100:00100000:2.0:1787190761.545699:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787190761.545706:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2419:x1874004672684416:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190761.545747:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+5:2419:x1874004672684416:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 41us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.545753:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 57 00000100:00100000:2.0:1787190761.545766:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:2.0:1787190761.545771:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2419:x1874004672684672:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190761.545797:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+6:2419:x1874004672684672:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 26us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.545803:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 58 00000100:00100000:2.0:1787190761.545813:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:2.0:1787190761.545818:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:2419:x1874004672684288:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190761.545838:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0dd54dd8-130e-44a0-a5c2-68ac863166bc+22:2419:x1874004672684288:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 20us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.545850:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 59 00000100:00100000:2.0:1787190761.545860:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00100000:2.0:1787190761.545866:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99f17c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672684800:12345-192.168.202.22@tcp:400:kworker.0 00000100:00100000:2.0:1787190761.545888:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99f17c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f88c9d17-193a-4950-a347-b37a2d40d3d0+5:2419:x1874004672684800:12345-192.168.202.22@tcp:400:kworker.0 Request processed in 22us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787190761.545893:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.22@tcp, seq: 60 00000100:00080000:3.0:1787190761.546674:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787190761.546680:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1787190761.546683:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787190761.546685:0:22754:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787190762.258867:0:22748:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787190762.614052:0:25843:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787190763.284404:0:22747:0:(ldlm_lockd.c:2820:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13850 lines, 13850 kept, 0 dropped, 0 bad.